Robust Domain-Mixture Scheduling for Multi-Teacher On-Policy Distillation
cs.CL
Submitted: 2026-11-09
Updated: 2026-11-09
Terminology
Sources
- Counteraction-Aware Multi-Teacher On-Policy Distillation for General Capability Recovery with Domain Preservation
- Latent-MOPD: Latent Multi-Teacher On-Policy Distillation
- Distilling the Knowledge in a Neural Network
- TACO: Topics in Algorithmic COde generation dataset
- A Fisher-Geometric View of Multi-Teacher On-Policy Distillation
- MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Training
- Generalizing Verifiable Instruction Following
- Proximal Policy Optimization Algorithms
- Distill What You Trust: Reliability-Aware Multi-Teacher On-Policy Distillation
- D cubed-MOPD: Dynamic Domain ScheDuling for Efficient Multi-Teacher Distillation
- Beyond Domain-Routed Supervision: Cross-Teacher Guarding for Multi-Teacher On-Policy Distillation
- Qwen3 Technical Report
- DAPO: An Open-Source LLM Reinforcement Learning System at Scale
- Verify Before You Distill: Prompt-Level Teacher Gating for On-Policy Distillation
- Instruction-Following Evaluation for Large Language Models
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data