EMO: Pretraining mixture of experts for emergent modularity

发生了什么

EMO is a new mixture-of-experts model trained so modular expert groups emerge from data, enabling users to select small task-specific expert subsets while preserving near full-model performance.

摘要按规则整理自下方来源原文

来源