Mix, Don't Tune: Bilingual Pre-Training Outperforms Hyperparameter Search in Data-Constrained Settings

发生了什么

For most languages of the world, language model pre-training operates in a data-constrained regime where models must repeat their training…

摘要按规则整理自下方来源原文

来源