Lune

EMNLP Findings2025

When Models Reason in Your Language: Controlling Thinking Language Comes at the Cost of Accuracy

Jirui Qi, Shan Chen, Zidi Xiong, Raquel Fernández, Danielle S. Bitterman, Arianna Bisazza

摘要

Recent Large Reasoning Models (LRMs) with thinking traces have shown strong performance on English reasoning tasks. However, the extent to which LRMs can think in other languages is less studied. This is as important as answer accuracy for real-world applications since users may find the thinking trace useful for oversight only if expressed in their languages. In this work, we comprehensively evaluate two leading families of LRMs on our established benchmark XReasoning. Surprisingly, even the most advanced models often revert to English or produce fragmented reasoning in other languages, revealing a substantial gap in the capability of thinking in non-English languages. Promoting models to reason in the user's language via prompt hacking enhances readability and oversight. This could gain user trust, but reduces answer accuracy, exposing an important trade-off. We further demonstrate that targeted post-training, even with just 100 instances, can mitigate this language mismatch, although accuracy is still degraded. Our results reveal the limited multilingual reasoning capabilities of current LRMs and suggest directions for future research.

问 Lune

尽管问,回答会引用原文。

Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。

可以从这些问题问起

Lune 的依据

全文 · 引用它的 5 篇顶会 Paper · 相关的 Paper

获取答案

免费开始,无需绑卡

引用它的顶会 Paper5

  1. Long Chain-of-Thought Reasoning Across LanguagesJosh Barua, Seun Eisape, Kayo Yin, Alane SuhrICLR 2026 · 21 次引用
  2. Evaluating Robustness of Large Language Models Against Multilingual Typographical ErrorsRaoyuan Zhao, Yihong Liu, Lena Altinger, Hinrich Schütze 等ACL 2026 · 6 次引用
  3. Language of Thought Shapes Output Diversity in Large Language ModelsShaoyang Xu, Wenxuan ZhangACL 2026 · 3 次引用
  4. LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint GuidanceYuchun Fan, Bei Li, Peiguang Li, Yilin Wang 等ACL 2026 · 1 次引用
  5. Routing and Reasoned Evaluation with Large Language ModelsGuiyao Tie, Tianyao Luo, Xueyang Zhou, Chaoran Hu 等ICML 2026

它引用的 Paper5

  1. Efficient Memory Management for Large Language Model Serving with PagedAttentionWoosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng 等SOSP 2023 · 1,016 次引用
  2. Chain-of-Thought Reasoning In The Wild Is Not Always FaithfulIván Arcuschin, Jett Janiak, Robert Krzyzanowski, Senthooran Rajamanoharan 等ICML 2026 · 175 次引用
  3. MEGA: Multilingual Evaluation of Generative AIKabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng 等EMNLP 2023 · 91 次引用
  4. Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought PromptingHaoyang Huang, Tianyi Tang, Dongdong Zhang, Xin Zhao 等EMNLP Findings 2023 · 76 次引用
  5. A Survey of Multilingual Reasoning in Language ModelsAkash Ghosh, Debayan Datta, Sriparna Saha, Chirag AgarwalEMNLP Findings 2025 · 2 次引用

相关 Paper

  1. Think Natively: Unlocking Multilingual Reasoning with Consistency-Enhanced Reinforcement LearningXue Zhang, Yunlong Liang, Fandong Meng, Songming Zhang 等ACL 2026 · 13 次引用
  2. Eliciting Better Multilingual Structured Reasoning from LLMs through CodeBryan Li, Tamer Alkhouli, Daniele Bonadiman, Nikolaos Pappas 等ACL 2024
  3. x1: Learning to Think Adaptively Across Languages and CulturesYangfan Ye, Xiaocheng Feng, Xiachong Feng, Yichong Huang 等ACL Findings 2026
  4. Large Reasoning Models Are (Not Yet) Multilingual Latent ReasonersYihong Liu, Raoyuan Zhao, Hinrich Schütze, Michael A. HedderichACL Findings 2026
  5. MPR-GUI: Benchmarking and Enhancing Multilingual Perception and Reasoning in GUI AgentsRuihan Chen, Qiming Li, Xiaocheng Feng, Weihong Zhong 等ACL 2026 · 3 次引用
黄昏的海面,两侧是细线勾勒的悬崖