Feature
OPSD: a new technique to make AI agents smarter through self-distillation
Amy Reed · 15 May 2026
Reinforcement learning drives post-training for LLM agents but offers coarse trajectory rewards. OPSD complements it with dense token-level guidance from a teacher model.
Researchers introduced On-Policy Self-Distillation (OPSD) to improve reinforcement learning for post-training LLM agents. OPSD adds dense token-level guidance from a teacher model to RL's coarse trajectory-level rewards. This enables finer supervision during long-horizon interactions.