trunk/fa395bc9477c679f59905341e444efe1a74a3e64: [xpu] Update SDPA OneDNN graph for training performance (#195419)
- PyTorch 近 90 天出现 916 次
- PyTorch 近 90 天第 905 次发版
- 上一次:同一天稍早 · trunk/040475b07b1a31d91f9a1251385a4c217402af18
发生了什么
Split from PR #162454 . This PR only changes files under XPU mkldnn for review quickly. OneDNN v3.12 supports GQA/dropout and refactor the SDPA pattern so that they can get more precise information and do optmization in v3.13. This PR integrates GQA/dropout and aligns with the new graph pattern. Pull Request resolved: #195419 Approved by: https://github.com/Skylion007 , https://github.com/EikanWang , https://github.…
摘要按规则整理自下方来源原文