Skip to content
Feature

Study Analyzes Limits of On-Policy Distillation in Reasoning Models

Amy Reed · 13 May 2026

Researchers analyzed on-policy distillation for reasoning models. They identified training conditions that boost or limit performance and evaluated optimal teacher models plus self-distillation.

A new research paper analyzes on-policy distillation for training reasoning models. It offers dense per-token supervision but reveals conditions where the signal helps or hurts performance. The study examines optimal teacher models and specific contexts for self-distillation.

Keep reading, free

Join the My AI Guide email to read the full story, what it means for you and the sources. One email every Monday.

One email every Monday. We will send a quick confirm first, so we know it is really you. Privacy Policy.