trunk/76588348eb3e6d543e06f04751268a19f57bca8d: Fix post-local SGD checkpoint reload race (#194614)
- PyTorch 近 90 天出现 2356 次
- PyTorch 近 90 天第 2326 次发版
- 上一次：同一天稍早 · viable/strict/1787946215: Publicize optim functional APIs under `torch.optim.functional` (#194986)
发生了什么
Summary Fixes #84886 . There was a race in the post-local SGD checkpoint reload test. Rank 0 created the temporary checkpoint and all ranks synchronized after it was written. However, there was no synchronization after loading. Rank 0 could complete the test first, leave the temporary-file context, and delete the checkpoint before another rank opened it, causing FileNotFoundError. Serialize the checkpoint into an in…
摘要按规则整理自下方来源原文