Reinforcing What the Student Has Learned: Teacher-Guided On-Policy Distillation
cs.LG
Submitted: 2026-11-05
Updated: 2026-11-06
Code: https://github.com/aim-uofa/sd-opd
Terminology
Sources
- Training Verifiers to Solve Math Word Problems
- Process Reinforcement through Implicit Rewards
- Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMs
- Revisiting On-Policy Distillation: Empirical Failure Modes and Simple Fixes
- MiniLLM: On-Policy Distillation of Large Language Models
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- Measuring Mathematical Problem Solving With the MATH Dataset
- On-Policy Delta Distillation
- Distilling the Knowledge in a Neural Network
- Reinforcement Learning via Self-Distillation
- DistiLLM: Towards Streamlined Distillation for Large Language Models
- DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMs
- Proximal Policy Optimization Algorithms
- Self-Distillation Enables Continual Learning
- Dr. OPD: Learning What to Follow for Optimal On-Policy Distillation of Large Language Models
- MiMo-V2-Flash Technical Report
- Qwen3 Technical Report
- Learning beyond Teacher: Generalized On-Policy Distillation with Reward Extrapolation
- Black-Box On-Policy Distillation of Large Language Models
- On-Policy Context Distillation for Language Models
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis