viable/strict/1792521211: [funcol] Add broadcast autograd (#200882)
- PyTorch 近 90 天出现 2615 次
- PyTorch 近 90 天第 2576 次发版
- 上一次:同一天稍早 · viable/strict/1792517296: [fx] Make _Patcher's already-patched guard actually fire (#201464)
发生了什么
_c10d_functional.broadcast has no autograd, unlike torch.distributed.nn.functional.broadcast . Fixes #200877 . Backward sums the grads onto src with the functional reduce, which returns zeros off src. This keeps backward rank agnostic, so it traces the same graph on every rank. Test plan: python -m pytest test/distributed/test_functional_differentials.py This PR was authored with an AI assistant (Claude). Pull Reque…
摘要按规则整理自下方来源原文