Beyond Domain-Routed Supervision: Cross-Teacher Guarding for Multi-Teacher On-Policy Distillation
cs.AI
Submitted: 2026-10-09
Updated: 2026-10-09
Terminology
Sources
- HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMs
- Counteraction-Aware Multi-Teacher On-Policy Distillation for General Capability Recovery with Domain Preservation
- Process Reinforcement through Implicit Rewards
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
- DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning
- Distilling the Knowledge in a Neural Network
- Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipe
- m1: Unleash the Potential of Test-Time Scaling for Medical Reasoning with Large Language Models
- LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
- What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Exams
- Filter, Then Reweight: Rethinking Optimization Granularity in On-Policy Distillation
- MoDoMoDo: Multi-Domain Data Mixtures for Multimodal LLM Reinforcement Learning
- On-policy Distillation with Verifiable Reward
- SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplines
- MOPD: Multi-Teacher On-Policy Distillation for Capability Integration in LLM Post-Training
- GPT-4 Technical Report
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems