Understanding the Out-of-Distribution Generalization of Chain-of-Thought Reasoning in LLMs
cs.LG, stat.ML
Submitted: 2026-11-04
Updated: 2026-11-04
Code: https://github.com/maxliang114514/CoT-OOD
Terminology
Sources
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- Task Generalization With AutoRegressive Compositional Structure: Can Learning From $D$ Tasks Generalize to $D^{T}$ Tasks?
- Training Verifiers to Solve Math Word Problems
- Sample Complexity of Autoregressive Reasoning: Chain-of-Thought vs. End-to-End
- All Roads Lead to Likelihood: The Value of Reinforcement Learning in Fine-Tuning
- Rethinking Reflection in Pre-Training
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis