← 返回事件
持续讨论AI发版

trunk/68d20d4ee3956ceb5fecbc1676112aa32d2ad7d9: Disable USE_FLASH_ATTENTION when no CUDA arch supports it (#194502)

发生了什么

USE_FLASH_ATTENTION stays ON for any CUDA build regardless of target architecture, even though the kernels need sm80+ and can_use_flash_attention() rejects anything below that at runtime. A build pinned to older hardware compiles the whole kernel set (the largest source tree under third_party) into a binary that can never use it. Disable the option when none of the resolved CUDA architectures reach sm80. Reuses NVCC…

摘要按规则整理自下方来源原文

为什么在扩散

时间线

  1. PyTorch Releases 最先出现PyTorch Releases

来源