← 返回事件
持续讨论AI发版

ciflow/trunk/201190: ATen: Support output-shaped FP8 residual bias on ROCm (#201190)

图:PyTorch Releases

发生了什么

Summary: Support a BF16 output-shaped residual through the v1 torch._scaled_mm bias argument on ROCm with rowwise input scales. Add the residual in the GEMM epilogue before BF16 rounding. Detect matrix residuals by their two-dimensional output shape, including single-row outputs; element count alone must not route [1, N] residuals as vector bias. Preserve vector-bias compatibility and CUDA matrix-bias rejection. Rej…

摘要按规则整理自下方来源原文

为什么在扩散

来源