P squared-MOPD: Accelerating Multi-Teacher On-Policy Distillation via Parameter Priors
cs.LG, cs.AI
Submitted: 2026-11-02
Updated: 2026-11-05
Code: https://github.com/SinuoWang/P2-MOPD
Terminology
Sources
- $\tau^2$-Bench: Evaluating Conversational Agents in a Dual-Control Environment
- Fusing finetuned models for better pretraining
- DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
- Rethinking On-Policy Distillation of Large Language Models II: One Training Example
- Merging in a Bottle: Differentiable Adaptive Merging (DAM) and the Path from Averaging to Automation
- AsyncOPD: How Stale Can On-Policy Distillation Be?
- No Pain, More Gain: Iterative Merging for Effective Multi-Teacher On-Policy Distillation
- Kimi K3: Open Frontier Intelligence
- Rethinking On-Policy Distillation of Large Language Models: Phenomenology, Mechanism, and Recipe
- MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Training
- One Student, Many Teachers: Multi-Task On-Policy Distillation via Soft-Prompt Privileged Context
- Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning
- Proximal Policy Optimization Algorithms
- Merge-of-Thought Distillation
- TinyR1-32B-Preview: Boosting Accuracy with Branch-Merge Distillation
- MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement
- MiMo-V2-Flash Technical Report
- Trust Region On-Policy Distillation
- MOPD-Router: Rethinking Teacher Routing in Multi-Teacher On-Policy Distillation
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis