ACL Findings2026
Why Do Multilingual Reasoning Gaps Emerge in Reasoning Language Models?
Deokhyung Kang, Seonjeong Hwang, Daehui Kim, Hyounghun Kim, Gary Lee
Abstract
Reasoning language models (RLMs) achieve strong performance on complex reasoning tasks, yet they still exhibit a multilingual reasoning gap, performing better in high-resource languages than in low-resource ones.While recent efforts have been made to address this gap, its underlying causes remain largely unexplored.In this work, we show that this gap primarily stems from failures in language understanding-specifically, the model's inability to translate multilingual inputs into the language dominating its reasoning traces (typically English).As identifying understanding failures can enable targeted mitigation of the gap, we evaluate a range of detection methods and find that understanding failures are detectable to a meaningful extent, with supervised approaches performing best.Building on this, we propose Selective Translation, a strategy that incorporates an English translation into the initial reasoning trace when an understanding failure is detected.Experimental results using Qwen3-4B show that Selective Translation substantially bridges the multilingual reasoning gap, achieving near full-translation performance while translating only about 20% of inputs.Together, our results show that failures in language understanding are the primary driver of the multilingual reasoning gap and can be detected and selectively mitigated, clarifying its origin and suggesting a path toward more equitable multilingual reasoning.1 barriers in multilingual mathematical reasoning: In- sights and observations.In
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 1 top-tier paper that cites it · related work
Free to start. No credit card required.
Cited by top-tier papers1
Builds on2
Related papers
- Beyond English-Centric Training: How Reinforcement Learning Improves Cross-Lingual Reasoning in LLMsShulin Huang, Yiran Ding, Junshu Pan, Yue ZhangICLR 2026 · 11 citations
- MindMerger: Efficiently Boosting LLM Reasoning in non-English LanguagesZixian Huang, Wenhao Zhu, Gong Cheng, Lei Li et al.NeurIPS 2024 · 31 citations
- Question Translation Training for Better Multilingual ReasoningWenhao Zhu, Shujian Huang, Fei Yuan, Shuaijie She et al.ACL Findings 2024 · 7 citations
- EfficientXLang: Towards Improving Token Efficiency Through Cross-Lingual ReasoningSanchit Ahuja, Praneetha Vaddamanu, Barun PatraEMNLP Findings 2025
- MAPO: Advancing Multilingual Reasoning through Multilingual-Alignment-as-Preference OptimizationShuaijie She, Wei Zou, Shujian Huang, Wenhao Zhu et al.ACL 2024
