trunk/610343e5acab74781f4ac043633d32465f8a86e5: [inductor] Skip SDPA fusion when the matched scale is a Tensor (#191496)
- PyTorch: 89 events in the last 90 days
- PyTorch: 89th Release in the last 90 days
- Previous: earlier the same day · v2.14.0-rc8
What happened
Fixes #191203 What happens Writing attention as q @ k.transpose(-2, -1) / scale with a 0-d tensor scale works in eager but crashes under torch.compile: RuntimeError: aten::scaled_dot_product_attention() Expected a value of type 'Optional[float]' for argument 'scale' but instead found type 'FakeTensor'. Cast error details: cannot extract float from tensor with meta storage fuse_attention.py has two families of sfdp p…
Summary assembled by rule from the sources below