Author
Acyr Locatelli
Papers that credit Acyr Locatelli in their source bylines. Matching names may refer to different researchers.
2 results
Papers that credit Acyr Locatelli in their source bylines. Matching names may refer to different researchers.
2 results
Tests of synthetic pre-pretraining find no fixed-budget language modeling advantage over natural-language-only training in the settings studied.

Measurements show why sparse MoE models can gain at low batch sizes, while an IPF framework estimates expert reuse in tested models.