Lune

EMNLP Findings2025

When Models Reason in Your Language: Controlling Thinking Language Comes at the Cost of Accuracy

Jirui Qi, Shan Chen, Zidi Xiong, Raquel Fernández, Danielle S. Bitterman, Arianna Bisazza

Abstract

Recent Large Reasoning Models (LRMs) with thinking traces have shown strong performance on English reasoning tasks. However, the extent to which LRMs can think in other languages is less studied. This is as important as answer accuracy for real-world applications since users may find the thinking trace useful for oversight only if expressed in their languages. In this work, we comprehensively evaluate two leading families of LRMs on our established benchmark XReasoning. Surprisingly, even the most advanced models often revert to English or produce fragmented reasoning in other languages, revealing a substantial gap in the capability of thinking in non-English languages. Promoting models to reason in the user's language via prompt hacking enhances readability and oversight. This could gain user trust, but reduces answer accuracy, exposing an important trade-off. We further demonstrate that targeted post-training, even with just 100 instances, can mitigate this language mismatch, although accuracy is still degraded. Our results reveal the limited multilingual reasoning capabilities of current LRMs and suggest directions for future research.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 5 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers5

  1. Long Chain-of-Thought Reasoning Across LanguagesJosh Barua, Seun Eisape, Kayo Yin, Alane SuhrICLR 2026 · 21 citations
  2. Evaluating Robustness of Large Language Models Against Multilingual Typographical ErrorsRaoyuan Zhao, Yihong Liu, Lena Altinger, Hinrich Schütze et al.ACL 2026 · 6 citations
  3. Language of Thought Shapes Output Diversity in Large Language ModelsShaoyang Xu, Wenxuan ZhangACL 2026 · 3 citations
  4. LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint GuidanceYuchun Fan, Bei Li, Peiguang Li, Yilin Wang et al.ACL 2026 · 1 citation
  5. Routing and Reasoned Evaluation with Large Language ModelsGuiyao Tie, Tianyao Luo, Xueyang Zhou, Chaoran Hu et al.ICML 2026

Builds on5

  1. Efficient Memory Management for Large Language Model Serving with PagedAttentionWoosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng et al.SOSP 2023 · 1,016 citations
  2. Chain-of-Thought Reasoning In The Wild Is Not Always FaithfulIván Arcuschin, Jett Janiak, Robert Krzyzanowski, Senthooran Rajamanoharan et al.ICML 2026 · 175 citations
  3. MEGA: Multilingual Evaluation of Generative AIKabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng et al.EMNLP 2023 · 91 citations
  4. Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought PromptingHaoyang Huang, Tianyi Tang, Dongdong Zhang, Xin Zhao et al.EMNLP Findings 2023 · 76 citations
  5. A Survey of Multilingual Reasoning in Language ModelsAkash Ghosh, Debayan Datta, Sriparna Saha, Chirag AgarwalEMNLP Findings 2025 · 2 citations

Related papers

  1. Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement LearningXue Zhang, Yunlong Liang, Fandong Meng, Songming Zhang et al.ACL 2026 · 13 citations
  2. Eliciting Better Multilingual Structured Reasoning from LLMs through CodeBryan Li, Tamer Alkhouli, Daniele Bonadiman, Nikolaos Pappas et al.ACL 2024
  3. x1: Learning to Think Adaptively Across Languages and CulturesYangfan Ye, Xiaocheng Feng, Xiachong Feng, Yichong Huang et al.ACL Findings 2026
  4. Large Reasoning Models Are (Not Yet) Multilingual Latent ReasonersYihong Liu, Raoyuan Zhao, Hinrich Schütze, Michael A. HedderichACL Findings 2026
  5. MPR-GUI: Benchmarking and Enhancing Multilingual Perception and Reasoning in GUI AgentsRuihan Chen, Qiming Li, Xiaocheng Feng, Weihong Zhong et al.ACL 2026 · 3 citations
Dusk over the sea between two cliffs drawn in fine vertical lines