Contrastive On-Policy Distillation
Contrastive On-Policy Distillation (COPD) enhances LLM reasoning efficiency by contrasting how a frozen teacher scores a student's state under 'light-thinking' versus 'heavy-thinking' instructions. This creates an advantage signal that guides the student to learn concise reasoning strategies, significantly reducing output length while maintaining performance across various tasks.