ciflow/trunk/199610: [T273452478] Cache FBGEMM embedding kernel handles (#199610)
- PyTorch 近 90 天出现 1986 次
- PyTorch 近 90 天第 1959 次发版
- 上一次:同一天稍早 · ciflow/torchtitan/199988
发生了什么
Summary: Pull Request resolved: #199610 Adds separate thread-local single-entry caches for dense and row-wise-sparse FBGEMM embedding kernels, keyed by D and has_weight . Steady-state calls reuse the handle while key changes regenerate through the existing path. One entry per template instantiation intentionally bounds thread-local state and optimizes stable shapes; alternating keys regenerate. FBGEMM dispatch overr…
摘要按规则整理自下方来源原文