Research collection
#off-policy-correction
Research tagged off-policy-correction: explanations, evidence, limitations and connections between papers.
2 results
Reusing a student's first answers can improve distillation
Semi-on-policy distillation reuses a student's starting answers and outperformed standard distillation on 14 of 17 tested pairs.
COPC corrects stale weights and learning signals in language-model training
COPC corrects stale learning signals, with higher math and search accuracy than AReaL in two reported settings.