ACL Findings2024
MrRank: Improving Question Answering Retrieval System through Multi-Result Ranking Model
Danupat Khamnuansin, Tawunrat Chalothorn, Ekapol Chuangsuwanich
摘要
Large Language Models (LLMs) often struggle with hallucinations and outdated information.To address this, Information Retrieval (IR) systems can be employed to augment LLMs with up-to-date knowledge.However, existing IR techniques contain deficiencies, posing a performance bottleneck.Given the extensive array of IR systems, combining diverse approaches presents a viable strategy.Nevertheless, prior attempts have yielded restricted efficacy.In this work, we propose an approach that leverages learning-to-rank techniques to combine heterogeneous IR systems.We demonstrate the method on two Retrieval Question Answering (ReQA) tasks.Our empirical findings exhibit a significant performance enhancement, outperforming previous approaches and achieving state-of-the-art results on ReQA SQuAD.
问 Lune
尽管问,回答会引用原文。
Lune 会读完全文和相关的 Paper,每个回答都附上所依据的原文段落。
它引用的 Paper3
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni 等NeurIPS 2020 · 19,162 次引用
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger 等ICLR 2020 · 8,443 次引用
- MPNet: Masked and Permuted Pre-training for Language UnderstandingKaitao Song, Xu Tan, Tao Qin, Jianfeng Lu 等NeurIPS 2020 · 1,957 次引用
相关 Paper
- Synergistic Interplay between Search and Large Language Models for Information RetrievalJiazhan Feng, Chongyang Tao, Xiubo Geng, Tao Shen 等ACL 2024 · 7 次引用
- CIRAG: Retrieval-Augmented Language Model with Collective IntelligenceChenxu Cui, Haihui Fan, Jinchao Zhang, Lin Shen 等SIGIR 2025 · 5 次引用
- Searching for Best Practices in Retrieval-Augmented GenerationXiaohua Wang, Zhenghua Wang, Xuan Gao, Feiran Zhang 等EMNLP 2024 · 75 次引用
- The Power of Noise: Redefining Retrieval for RAG SystemsFlorin Cuconasu, Giovanni Trappolini, Federico Siciliano, Simone Filice 等SIGIR 2024 · 212 次引用
- PRCA: Fitting Black-Box Large Language Models for Retrieval Question Answering via Pluggable Reward-Driven Contextual AdapterHaoyan Yang, Zhitao Li, Yong Zhang, Jianzong Wang 等EMNLP 2023 · 16 次引用
