Knowing When to Teach: Learning from Teachable Prefixes in Multilingual Reasoning Distillation
cs.CL, cs.AI
Submitted: 2026-11-05
Updated: 2026-11-05
Terminology
Sources
- GPT-4 Technical Report
- The Llama 3 Herd of Models
- Trajectory-Refined Distillation
- Crosslingual On-Policy Self-Distillation for Multilingual Reasoning
- Trust-Region Behavior Blending for On-Policy Distillation
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- Gemini: A Family of Highly Capable Multimodal Models
- STEPS: Selective On-Policy Self-Distillation for Reasoning
- Qwen3 Technical Report
- Qwen2.5 Technical Report
Related papers
- ALARM: Audio-Language Alignment for Reasoning Models
- ThinkSum: Probabilistic reasoning over sets using large language models
- Coherence boosting: When your pretrained language model is not paying enough attention
- From Facts to Insights: A Persona-Driven Dual Memory Framework and Dataset for Role-Playing Agents
- Improving General Role-Playing Agents via Psychology-Grounded Reasoning and Role-Aware Policy Optimization
- The Art of Asking: Multilingual Prompt Optimization for Synthetic Data