Feature
Study Analyzes Limits of On-Policy Distillation in Reasoning Models
Amy Reed · 13 May 2026
Researchers analyzed on-policy distillation for reasoning models. They identified training conditions that boost or limit performance and evaluated optimal teacher models plus self-distillation.
A new research paper analyzes on-policy distillation for training reasoning models. It offers dense per-token supervision but reveals conditions where the signal helps or hurts performance. The study examines optimal teacher models and specific contexts for self-distillation.