viable/strict/1788439121: [MPS] migrate log softmax to metal (#195441)
- PyTorch 近 90 天出现 2656 次
- PyTorch 近 90 天第 2615 次发版
- 上一次:同一天稍早 · trunk/56ff81dade97f30294ac89a786b1f3516ad993bb: [xpu] Add non split pool support on xpu caching allcoator (#192033)
发生了什么
Following #195368 of PRs for reducing memory usage for the ops which are mainly on modern model inference/training side and use MPS Graph, next one being log_softmax. To briefly explain the kernels, there are 4: log_softmax_row - used when dim we are reducing on is relatively small ( =128) to keep gpu saturated (reduction dim should be contiguous) log_softmax_partial and log_softmax_finalize - Regular 2 pass kernel,…
摘要按规则整理自下方来源原文