Learning When to Translate for Multilingual Reasoning
cs.CL, cs.AI
Submitted: 2026-06-01
Updated: 2026-10-13
Comments: preprint v2
Code: https://github.com/deokhk/LUAR
License: http://creativecommons.org/licenses/by/4.0/
The gist: Reasoning language models (RLMs) achieve strong performance on complex reasoning tasks, but still exhibit substantial multilingual reasoning gaps, largely due to language-understanding failures when
Terminology
Abstract
Reasoning language models (RLMs) achieve strong performance on complex reasoning tasks, but still exhibit substantial multilingual reasoning gaps, largely due to language-understanding failures when interpreting non-English inputs. Translation into English can mitigate these failures by expressing non-English inputs in a form that RLMs can more reliably interpret, yet translating every input incurs unnecessary inference cost when the model can reason reliably from the original query. To address this challenge, we propose Luar, a Language Understanding Boundary-aware Reinforcement Learning framework that trains RLMs to selectively invoke translation when their direct understanding is unreliable. Luar trains the model to either solve the original input directly or reason over its English translation, encouraging translation only when translator-augmented reasoning is expected to substantially outperform direct reasoning. Across multilingual reasoning benchmarks, Luar outperforms training-based baselines, with particularly large gains on low-resource languages. On Qwen3-4B, it improves average accuracy by 8.4 percentage points over standard GRPO. Further analysis shows that Luar concentrates translator calls on queries where translation benefits reasoning, helping to reduce inference cost. The project will be made publicly available at https://github.com/deokhk/LUAR.
Sources
- xCoT: Cross-lingual Instruction Tuning for Cross-lingual Chain-of-Thought Reasoning
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- ReTool: Reinforcement Learning for Strategic Tool Use in LLMs
- TAPO: Translation Augmented Policy Optimization for Multilingual Mathematical Reasoning
- Learn Globally, Speak Locally: Bridging the Gaps in Multilingual Reasoning
- VerlTool: Towards Holistic Agentic Reinforcement Learning with Tool Use
- Why Do Multilingual Reasoning Gaps Emerge in Reasoning Language Models?
- What Makes Good Multilingual Reasoning? Disentangling Traces with Measurable Features
- Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gap
- R3S: Refining and Recovering Reinforcement Signals for Multilingual Understanding and Reasoning
- Crosslingual On-Policy Self-Distillation for Multilingual Reasoning
- Decoupled Weight Decay Regularization
- gpt-oss-120b & gpt-oss-20b Model Card
- OpenAI o1 System Card
- Adapting Language-Specific LLMs to a Reasoning Model in One Day via Model Merging -- An Open Recipe
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- Language Matters: How Do Multilingual Input and Reasoning Paths Affect Large Reasoning Models?
- Qwen3 Technical Report
- RCP-Merging: Merging Long Chain-of-Thought Models with Domain-Specific Models by Considering Reasoning Capability as Prior
- DAPO: An Open-Source LLM Reinforcement Learning System at Scale
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering