← 返回事件
持续讨论科技发版

trunk/74b55cafb21cf7d14bf8adc466e256ef2b994533: Make the int4mm sm_80 requirement an actual runtime check (#195697)

发生了什么

_weight_int4pack_mm_cuda / _convert_weight_to_int4pack_cuda gate on !defined(__CUDA_ARCH__) || (__CUDA_ARCH__ >= 800) , with a TORCH_CHECK(false, ...) in the other arm. Both are host functions, and __CUDA_ARCH__ is only defined during nvcc's device compilation pass -- so !defined(__CUDA_ARCH__) is always true when this is preprocessed for the host, and the check is unreachable in every build. The "requires sm_80" co…

摘要按规则整理自下方来源原文

为什么在扩散

来源