Lune

ACL Findings2024

MrRank: Improving Question Answering Retrieval System through Multi-Result Ranking Model

Danupat Khamnuansin, Tawunrat Chalothorn, Ekapol Chuangsuwanich

Abstract

Large Language Models (LLMs) often struggle with hallucinations and outdated information.To address this, Information Retrieval (IR) systems can be employed to augment LLMs with up-to-date knowledge.However, existing IR techniques contain deficiencies, posing a performance bottleneck.Given the extensive array of IR systems, combining diverse approaches presents a viable strategy.Nevertheless, prior attempts have yielded restricted efficacy.In this work, we propose an approach that leverages learning-to-rank techniques to combine heterogeneous IR systems.We demonstrate the method on two Retrieval Question Answering (ReQA) tasks.Our empirical findings exhibit a significant performance enhancement, outperforming previous approaches and achieving state-of-the-art results on ReQA SQuAD.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on3

  1. Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
  2. BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
  3. MPNet: Masked and Permuted Pre-training for Language UnderstandingKaitao Song, Xu Tan, Tao Qin, Jianfeng Lu et al.NeurIPS 2020 · 1,957 citations

Related papers

  1. Synergistic Interplay between Search and Large Language Models for Information RetrievalJiazhan Feng, Chongyang Tao, Xiubo Geng, Tao Shen et al.ACL 2024 · 7 citations
  2. CIRAG: Retrieval-Augmented Language Model with Collective IntelligenceChenxu Cui, Haihui Fan, Jinchao Zhang, Lin Shen et al.SIGIR 2025 · 5 citations
  3. Searching for Best Practices in Retrieval-Augmented GenerationXiaohua Wang, Zhenghua Wang, Xuan Gao, Feiran Zhang et al.EMNLP 2024 · 75 citations
  4. The Power of Noise: Redefining Retrieval for RAG SystemsFlorin Cuconasu, Giovanni Trappolini, Federico Siciliano, Simone Filice et al.SIGIR 2024 · 212 citations
  5. PRCA: Fitting Black-Box Large Language Models for Retrieval Question Answering via Pluggable Reward-Driven Contextual AdapterHaoyan Yang, Zhitao Li, Yong Zhang, Jianzong Wang et al.EMNLP 2023 · 16 citations
Dusk over the sea between two cliffs drawn in fine vertical lines