Lune

ACL Findings2026

Enhancing Multilingual RAG Systems with Debiased Language Preference-Guided Query Fusion

Jeonghyun Park, Byeongjeong Kim, Seojin Hwang, Hwanhee Lee

Abstract

Multilingual Retrieval-Augmented Generation (mRAG) systems often exhibit a perceived preference for high-resource languages, particularly English, resulting in the widespread adoption of English pivoting. While prior studies attribute this advantage to the superior Englishcentric capabilities of Large Language Models (LLMs), we find that such measurements are significantly distorted by structural priors inherent in evaluation benchmarks. Specifically, we identify exposure bias and a gold availability prior-both driven by the disproportionate concentration of resources in English-as well as cultural priors rooted in topic locality, as factors that hinder accurate assessment of genuine language preference. To address these biases, we propose DeLP (Debiased Language Preference), a calibrated metric designed to explicitly factor out these structural confounds. Our analysis using DeLP reveals that the previously reported English preference is largely a byproduct of evidence distribution rather than an inherent model bias. Instead, we find that retrievers fundamentally favor monolingual alignment between the query and the document language. Building on this insight, we introduce DELTA (DEbiased Language preference-guided Text Augmentation), a lightweight and efficient mRAG framework that strategically leverages monolingual alignment to optimize crosslingual retrieval and generation. Experimental results demonstrate that DELTA consistently outperforms English pivoting and mRAG baselines across diverse languages. The Code is available at https://github.com/ jeonghyunpark2002/DELTA.git

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on8

  1. Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
  2. M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge DistillationJianlyu Chen, Shitao Xiao, Peitian Zhang, Kun Luo et al.ACL Findings 2024 · 762 citations
  3. Don't Trust ChatGPT when your Question is not in English: A Study of Multilingual Abilities and Types of LLMsXiang Zhang, Senyu Li, Bradley Hauer, Ning Shi et al.EMNLP 2023 · 58 citations
  4. BERGEN: A Benchmarking Library for Retrieval-Augmented GenerationDavid Rau, Hervé Déjean, Nadezhda Chirkova, Thibault Formal et al.EMNLP Findings 2024 · 17 citations
  5. Linguistic Nepotism: Trading-off Quality for Language Preference in Multilingual RAGDayeon Ki, Marine Carpuat, Paul McNamee, Daniel Khashabi et al.ICML 2026 · 7 citations

Related papers

  1. Investigating Language Preference of Multilingual RAG SystemsJeonghyun Park, Hwanhee LeeACL Findings 2025 · 5 citations
  2. All Languages Matter: Understanding and Mitigating Language Bias in Multilingual RAGDan Wang, Guozhao Mo, Yafei Shi, Cheng Zhang et al.ACL 2026
  3. Breaking Language Preference in Multilingual RAG via Language-Controllable Retrieval and Language-Agnostic ReasoningWenshuai Huo, Xiaocheng Feng, Baohang Li, Chengpeng Fu et al.ACL Findings 2026
  4. Language-Coupled Reinforcement Learning for Multilingual Retrieval-Augmented GenerationRui Qi, Fengran Mo, Yufeng Chen, Xue Zhang et al.ACL Findings 2026
  5. RPO: Retrieval Preference Optimization for Robust Retrieval-Augmented GenerationShi-Qi Yan, Quan Liu, Zhen-Hua LingACL 2025 · 4 citations
Dusk over the sea between two cliffs drawn in fine vertical lines