Research collection
#policy-distillation
Research tagged policy-distillation: explanations, evidence, limitations and connections between papers.
3 results
Choosing fewer, better tokens improves distillation
DIAL-OPD ranks response tokens by disagreement and probability, improving mean accuracy over full-token distillation in math tests.
One model learns faster image generation and understanding
A two-stage method cuts decoding steps while improving image and captioning results for a discrete multimodal model.
A human-trained user simulator improves agent training
MIMESIS models varied human behavior; agents trained with it score better than GPT-5.5-trained agents across nine simulated users.