trunk/10a2f3aa6abef3a84ad0ba37007fbce4d4681a6b: [TokenSwitch] Add symmetric-memory zero-copy dispatch/combine (#187785)
- PyTorch 近 90 天出现 240 次
- PyTorch 近 90 天第 237 次发版
- 上一次:同一天稍早 · trunk/748dc51db9dd19a621b6dda3d88b48dfe5e8274d
发生了什么
When a dispatch/combine tensor is backed by NCCLSymmetricMemory registered under the process group's name, address it via the registered ncclWindow + offset (RDMA zero-copy path) instead of a plain device pointer, avoiding a staging copy into a regular device buffer. Applies to dispatch inputs/outputs and combine inputs. EpTensor gains a window-backed constructor ( win_hdl + win_offset ). make_ep_tensor() looks up t…
摘要按规则整理自下方来源原文