Research collection
#expert-merging
1 paper tagged Expert merging. Each paper states what it shows and what it does not prove.
1 results
A trainable expert blend helps a student recover domain skills
Across four domains, a 1.7B student trained with learned expert-mixing coefficients recovered more teacher performance than a fixed-coefficient control.