Amazon SageMaker Inference: 2026 year-to-date launches in review

- AWS: 111 events in the last 90 days
- Previous: earlier the same day · Introducing Kimi K3 on Amazon Bedrock
What happened
Amazon SageMaker AI shipped 13 inference launches in the first half of 2026 across two deployment paths: fully managed endpoints and Amazon SageMaker HyperPod Inference. This post reviews each launch, from inference recommendations and capacity-aware instance pools to tiered KV caching and disaggregated prefill and decode.
Summary assembled by rule from the sources below