← 返回事件
持续讨论AI发版

viable/strict/1788331551: [ROCm][CK] Remove host-side FMHA sequence padding workaround (#195498)

图:PyTorch Releases

发生了什么

Summary: Context #187152 added a gfx950 host-side pad/copy stopgap after unpadded CK FMHA TRLOAD instances faulted on tile-unaligned Q/K sequence lengths. ROCm/rocm-libraries#11519 guards those generated dispatch arms so unaligned requests select CK's existing tail-safe kPadSeqLenQ/K instances. What Remove the external Q/K/V sequence padding, O/LSE scratch allocation, and output copies from the PyTorch CK FMHA wrapp…

摘要按规则整理自下方来源原文

为什么在扩散

来源