← 返回事件
持续讨论AI发版

viable/strict/1788439121: [MPS] migrate log softmax to metal (#195441)

发生了什么

Following #195368 of PRs for reducing memory usage for the ops which are mainly on modern model inference/training side and use MPS Graph, next one being log_softmax. To briefly explain the kernels, there are 4: log_softmax_row - used when dim we are reducing on is relatively small ( =128) to keep gpu saturated (reduction dim should be contiguous) log_softmax_partial and log_softmax_finalize - Regular 2 pass kernel,…

摘要按规则整理自下方来源原文

为什么在扩散

来源