Yestino - The Signal ยท FSDP2 Separatehttps://yestino.com/entities/fsdp2-separate-dc5ff0Every event involving FSDP2 Separateentrunk/38d3f6fd0d6e7ea5b68ee3854e1033ff08a5c92c: [FSDP2] Separate sharded and unsharded gradient dtypes (#194434)https://yestino.com/events/trunk-38d3f6fd0d6e7ea5b68ee3854e1033ff08a5c92c-fsdp2-separat-1ab337https://yestino.com/events/trunk-38d3f6fd0d6e7ea5b68ee3854e1033ff08a5c92c-fsdp2-separat-1ab337Fri, 02 Oct 2026 00:31:17 GMTFixes #170648 feature 0 : when mp_policy.reduce_dtype is None, it follows orig model.parameters() .grad_dtype. Sources: PyTorch Releases