O squared PD: Overlap-Gated On-Policy Distillation on Reliable Prefix
cs.CL, cs.AI
Submitted: 2026-11-05
Updated: 2026-11-05
Terminology
Sources
- Sparse Logit Sampling: Accelerating Knowledge Distillation in LLMs
- The Entropy Mechanism of Reinforcement Learning for Reasoning Language Models
- Revisiting On-Policy Distillation: Empirical Failure Modes and Simple Fixes
- JustRL: Scaling a 1.5B LLM with a Simple RL Recipe
- Measuring Mathematical Problem Solving With the MATH Dataset
- Distilling the Knowledge in a Neural Network
- Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Model
- Entropy-Aware On-Policy Distillation of Language Models
- DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMs
- Solving Quantitative Reasoning Problems with Language Models
- Understanding R1-Zero-Like Training: A Critical Perspective
- A Token-Level Analysis of Sampled-Token Reverse-KL On-Policy Distillation
- Demystifying On-Policy Distillation: Roles, Pathologies, and Regulations
- Not All Disagreement Is Learnable: Token Teachability in On-Policy Distillation
- Learning beyond Teacher: Generalized On-Policy Distillation with Reward Extrapolation
- DAPO: An Open-Source LLM Reinforcement Learning System at Scale
- Less is More: Early Stopping Rollout for On-Policy Distillation
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data