trunk/fa395bc9477c679f59905341e444efe1a74a3e64: [xpu] Update SDPA OneDNN graph for training performance (#195419)
- PyTorch: 911 events in the last 90 days
- PyTorch: 900th Release in the last 90 days
- Previous: earlier the same day · trunk/040475b07b1a31d91f9a1251385a4c217402af18
What happened
Split from PR #162454 . This PR only changes files under XPU mkldnn for review quickly. OneDNN v3.12 supports GQA/dropout and refactor the SDPA pattern so that they can get more precise information and do optmization in v3.13. This PR integrates GQA/dropout and aligns with the new graph pattern. Pull Request resolved: #195419 Approved by: https://github.com/Skylion007 , https://github.com/EikanWang , https://github.…
Summary assembled by rule from the sources below