viable/strict/1787598738: [sdpa] Fix bottom-right efficient attention when Q exceeds K (#193632)
- Fix 近 90 天出现 4 次
- Fix 近 90 天第 4 次发版
- 上一次：1 天前 · viable/strict/1787484326: [inductor] Fix flex flash captured-float test expectation (#194483)
发生了什么
Human Note Part 1 of doing the acutal change I want which is aligning both sdpa and varlen to lower-right the bettter choice of mask semantic in the age of llms. This fixes some edge cases that would have borken mem-eff. Currently not user facing since we are still on upper left Agent note This commit was authored with an AI assistant. CUDA memory-efficient attention stored the bottom-right causal diagonal offset as…
摘要按规则整理自下方来源原文