MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines

What happened

MTIA 300 is the first of Meta’s family of in-house training and inference accelerators optimized for training ranking and recommendation models. We’re sharing how MTIA 300’s built-in NIC chiplets allow it to meet the communication needs associated with training recommendation models with superior performance over general-purpose GPUs. By co-designing MTIA’s communication library, HCCL, alongside the [...] Read More.…

Summary assembled by rule from the sources below

Timeline

1. 17:45
   First appeared on Meta EngineeringMeta Engineering

Sources