How Well Does Mathematical Reasoning Transfer Across Languages in English-Centric LLMs?

arXiv:2510.02272 · cs.CL, cs.AI · Submitted 2025-10-02 · Read on arXiv

cs.CL, cs.AI

Submitted: 2025-10-02

Updated: 2026-10-22

Terminology

• Accuracy — 78× in this paper · explained in 1 episode
• GRPO — 59× in this paper · explained in 6 episodes
• Generalization — 45× in this paper · explained in 14 episodes
• Transferability — 45× in this paper · explained in 5 episodes
• Benchmark — 44× in this paper · explained in 2 episodes
• Cross-lingual Transfer — 11× in this paper · explained in 2 episodes
• Transferability Index — 10× in this paper
• Low-Resource Languages — 9× in this paper · explained in 4 episodes
• Reinforcement Learning — 9× in this paper · explained in 4 episodes
• Hyperparameters — 8× in this paper · explained in 2 episodes
• Multilingual Transferability Index — 7× in this paper
• Fine-Tuning — 6× in this paper · explained in 5 episodes
• Reinforcement Post-Training — 4× in this paper
• Adam — 3× in this paper · explained in 2 episodes
• Consistency — 3× in this paper · explained in 3 episodes
• Core — 3× in this paper · explained in 2 episodes
• Generalizability — 3× in this paper · explained in 6 episodes
• Test-Time Scaling — 3× in this paper · explained in 4 episodes
• In-Context Learning — 2× in this paper · explained in 7 episodes
• Interpretability — 2× in this paper · explained in 15 episodes
• Trace — 2× in this paper · explained in 2 episodes
• Abstraction — 1× in this paper · explained in 1 episode
• American Invitational Mathematics Examination — 1× in this paper
• Chain-of-Thought Prompting — 1× in this paper · explained in 2 episodes
• Failure Modes — 1× in this paper · explained in 3 episodes
• Instruction Tuning — 1× in this paper · explained in 3 episodes
• Language Models (LLMs) — 1× in this paper · explained in 2 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 8 episodes
• Large Reasoning Models Chain of Thought — 1× in this paper
• Mechanistic Interpretability — 1× in this paper · explained in 4 episodes
• Overfitting — 1× in this paper · explained in 2 episodes
• Papers — 1× in this paper · explained in 3 episodes
• RLVR — 1× in this paper · explained in 2 episodes
• Reinforcement Learning (RL) — 1× in this paper · explained in 26 episodes
• Reward Function — 1× in this paper · explained in 4 episodes
• Semantic Equivalence — 1× in this paper · explained in 2 episodes
• Structured Reasoning — 1× in this paper · explained in 3 episodes
• Supervised Fine-Tuning — 1× in this paper
• Supervised Fine-Tuning (SFT) — 1× in this paper · explained in 13 episodes
• Verifiable Rewards — 1× in this paper · explained in 2 episodes
• Vision-language models — 1× in this paper · explained in 2 episodes

Sources

• ACE-RL: Adaptive Constraint-Enhanced Reward for Long-form Generation Reinforcement Learning
• LR^2Bench: Evaluating Long-chain Reflective Reasoning Capabilities of Large Language Models via Constraint Satisfaction Problems
• OpenThoughts: Data Recipes for Reasoning Models
• DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
• Breaking Barriers: Do Reinforcement Post Training Gains Transfer To Unseen Domains?
• Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Model
• Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning
• OpenAI o1 System Card
• Look Again, Think Slowly: Enhancing Visual Reflection in Vision-Language Models
• Kimi k1.5: Scaling Reinforcement Learning with LLMs
• Tulu 3: Pushing Frontiers in Open Language Model Post-Training
• X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
• Understanding R1-Zero-Like Training: A Critical Perspective
• s1: Simple test-time scaling
• When Models Reason in Your Language: Controlling Thinking Language Comes at the Cost of Accuracy
• Just Go Parallel: Improving the Multilingual Capabilities of Large Language Models
• DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
• HybridFlow: A Flexible and Efficient RLHF Framework
• KTAE: A Model-Free Algorithm to Key-Tokens Advantage Estimation in Mathematical Reasoning
• Language Mixing in Reasoning Language Models: Patterns, Impact, and Internal Causes

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering