Which Language Should a Skeleton Speak? Language Choices in Multilingual Reasoning

arXiv:2610.09607 · cs.CL, cs.AI · Submitted 2026-10-07 · Read on arXiv

cs.CL, cs.AI

Submitted: 2026-10-07

Updated: 2026-10-07

Comments: Accepted to EMNLP 2026 (Findings)

Code: https://github.com/lhsstn/LASEF

License: http://creativecommons.org/licenses/by/4.0/

The gist: Skeleton-based reasoning prompting is a promising training-free approach for structuring LLM reasoning, but prior work largely assumes an English-centric setting.

Abstract

Skeleton-based reasoning prompting is a promising training-free approach for structuring LLM reasoning, but prior work largely assumes an English-centric setting. We propose the Language-Aware Skeleton Exploration Framework (LASEF) to study skeleton-language choice in multilingual mathematical reasoning. Across math benchmarks, model scales, and languages, we show that English skeletons yield a small positive tendency on average, most visible for smaller models and low-resource languages. However, few language-level gains remain significant after correction, and English is not universally optimal. Combining greedy decoding, multi-rollout evaluation, translation ablation, and cross-benchmark validation, we further find three patterns of skeleton-language effects: directionally consistent, evaluation- and benchmark-dependent, and asymmetric negative. These effects cannot be fully explained by generation quality alone. Overall, skeleton language is a context-dependent design variable that requires multi-level exploration. All resources are released at https://github.com/lhsstn/LASEF.

Sources

Related papers