← Back to events
ActiveAIRelease

trunk/610343e5acab74781f4ac043633d32465f8a86e5: [inductor] Skip SDPA fusion when the matched scale is a Tensor (#191496)

Photo: PyTorch Releases

What happened

Fixes #191203 What happens Writing attention as q @ k.transpose(-2, -1) / scale with a 0-d tensor scale works in eager but crashes under torch.compile: RuntimeError: aten::scaled_dot_product_attention() Expected a value of type 'Optional[float]' for argument 'scale' but instead found type 'FakeTensor'. Cast error details: cannot extract float from tensor with meta storage fuse_attention.py has two families of sfdp p…

Summary assembled by rule from the sources below

Why it's spreading

Sources