ciflow/torchtitan/200699: [inductor] Split persistent and looped reductions in combo kernels
- PyTorch 近 90 天出现 2241 次
- PyTorch 近 90 天第 2212 次发版
- 上一次:同一天稍早 · ciflow/torchtitan/200591
发生了什么
Summary: Without combo_kernel_per_subkernel_blocks , the sub-kernels of a combo kernel share one XBLOCK and one num_warps , and select_combo_heuristics takes the autotune configs from a single sub-kernel, a looped reduction whenever the combo has one. A persistent reduction keeps a whole row in registers and wants a small XBLOCK , while a looped reduction wants a large XBLOCK over a small R0_BLOCK , so in a mixed co…
摘要按规则整理自下方来源原文