← 返回事件
持续讨论AI发版

trunk/610343e5acab74781f4ac043633d32465f8a86e5: [inductor] Skip SDPA fusion when the matched scale is a Tensor (#191496)

图:PyTorch Releases

发生了什么

Fixes #191203 What happens Writing attention as q @ k.transpose(-2, -1) / scale with a 0-d tensor scale works in eager but crashes under torch.compile: RuntimeError: aten::scaled_dot_product_attention() Expected a value of type 'Optional[float]' for argument 'scale' but instead found type 'FakeTensor'. Cast error details: cannot extract float from tensor with meta storage fuse_attention.py has two families of sfdp p…

摘要按规则整理自下方来源原文

为什么在扩散

来源