State-OPD: State-Grounded On-Policy Distillation for Multi-Turn Agents
cs.LG
Submitted: 2026-10-09
Updated: 2026-10-09
Terminology
Sources
- Look Ahead Before You Distill: Future Trajectory Validation of Teacher Guidance for Agentic On-Policy Distillation
- Revisiting On-Policy Distillation: Empirical Failure Modes and Simple Fixes
- Rethinking On-Policy Distillation of Large Language Models II: One Training Example
- Know When to Stop, Where to Restart: Accelerating Multi-Turn Agentic On-Policy Distillation
- Asymmetric On-Policy Distillation: Bridging Exploitation and Imitation at the Token Level
- Scaling Reasoning Efficiently via Relaxed On-Policy Distillation
- On-Policy Distillation with Curriculum Turn-level Guidance for Multi-turn Agents
- Data-Free On-Policy Distillation: How Far Can We Go Without External Data?
- Multi-Turn On-Policy Distillation with Prefix Replay
- Same Evidence, Different Answers: Canonical-Context On-Policy Distillation for Multi-Turn Language Models
- When Privileged Guidance Misaligns: State-Matched Routing and Contextualized Self-Distillation for Multi-Turn Agents
- MemOPD: On-Policy Distillation through Memory State Alignment for Long-Horizon Agents
- ATOD: Annealed Turn-Aware On-Policy Distillation for Multi-Turn Agentic Tasks
- MAD-OPD: Breaking the Ceiling in On-Policy Distillation via Multi-Agent Debate
- TCOD: Exploring Temporal Curriculum in On-Policy Distillation for Multi-turn Autonomous Agents
- Qwen3 Technical Report
- On-Policy Context Distillation for Language Models
- Multi-Rollout On-Policy Distillation via Peer Successes and Failures
- MAIGO: Mitigating Lost-in-Conversation with History-Cleaned On-Policy Self-Distillation
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks