Learning Dynamics of On-Policy Distillation
cs.LG, cs.CL
Submitted: 2026-11-05
Updated: 2026-11-05
Terminology
Sources
- On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes
- Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning
- Towards Understanding Distilled Reasoning Models: A Representational Approach
- Llama-Nemotron: Efficient Reasoning Models
- Thought Anchors: Which LLM Reasoning Steps Matter?
- Evaluating Large Language Models Trained on Code
- DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
- Revisiting On-Policy Distillation: Empirical Failure Modes and Simple Fixes
- JustRL: Scaling a 1.5B LLM with a Simple RL Recipe
- Distilling the Knowledge in a Neural Network
- Entropy-Aware On-Policy Distillation of Language Models
- On-Policy Distillation with Curriculum Turn-level Guidance for Multi-turn Agents
- Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe
- Simple-OPD: Demystifying Warm-up for On-policy Distillation
- Qwen2.5 Technical Report
- Direct Preference Optimization: Your Language Model is Secretly a Reward Model
- Learning Dynamics of LLM Finetuning
- Reinforcement and Imitation Learning via Interactive No-Regret Learning
- On the Geometry of On-Policy Distillation
- A Survey of On-Policy Distillation for Large Language Models
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis