← Back to events
ActiveAIRelease9.24

trunk/79fcc0094dc424d271eb602ef51de265e4307c76: [varlen] Pass cumulative sequence lengths directly to cuDNN (#194906)

Photo: PyTorch Releases

What happened

Human Note Use new API and also update headdim support table Agent note This commit was authored with an AI assistant. cuDNN varlen forward currently converts cumulative sequence lengths into per-sequence lengths with diff and multiplies them by token strides to form ragged offsets. cuDNN 9.24 and Frontend 1.25 added direct cumulative-length inputs and per-tensor ragged-offset multipliers, so regular packed forward…

Summary assembled by rule from the sources below

Why it's spreading

Sources