From Retrieval to Generation: Unifying External and Parametric Knowledge for Medical Question Answering
Lei Li, Xiao Zhou, Yingying Zhang, Xian Wu
Abstract
Medical question answering (QA) demands reliable access to rich, domain-specific knowledge. A prevalent strategy enhances large language models (LLMs) with either external knowledge retrieved from medical corpora or parametric knowledge embedded with model parameters. Existing methods generally fall into two paradigms: Retrieval-Augmented Generation (RAG), which grounds reasoning in retrieved evidence, and Generation-Augmented Generation (GAG), which relies exclusively on internally generated contexts. However, RAG often suffers from noisy or incomplete retrieval, whereas GAG is prone to hallucinated or inaccurate content due to unconstrained generation. Both limitations can misguide reasoning and compromise answer reliability. To overcome these challenges, we propose MedRGAG, a unified retrieval--generation augmented framework that seamlessly integrates external and parametric knowledge for medical QA. MedRGAG consists of two core modules: Knowledge-Guided Context Completion (KGCC), which steers the generator to produce background documents that complement knowledge gaps revealed by retrieval, and Knowledge-Aware Document Selection (KADS), which adaptively selects an optimal combination of retrieved and generated documents to construct concise yet comprehensive evidence for answers. Extensive experiments on five medical QA benchmarks demonstrate that MedRGAG achieves a 12.5% improvement over MedRAG and a 4.5% gain over MedGENIE, highlighting the effectiveness of unifying retrieval and generation for knowledge-intensive medical reasoning. Further analyses show that our framework effectively generates complementary contexts and recovers informative retrieved evidence. Our code and data are publicly available at https://github.com/ll0ruc/MedRGAG.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ab7cd709-f07c-4579-8144-558d4a75bae3Builds on16
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
- Measuring Massive Multitask Language UnderstandingDan Hendrycks, Collin Burns, Steven Basart, Andy Zou et al.ICLR 2021 · 7,905 citations
- Self-RAG: Learning to Retrieve, Generate, and Critique through Self-ReflectionAkari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil et al.ICLR 2024 · 1,798 citations
Related papers
- From Conflict to Consensus: Boosting Medical Reasoning via Multi-Round Agentic RAGWenhao Wu, Zhentao Tang, Yafu Li, Shixiong Kai et al.ICML 2026
- Experience Retrieval-Augmentation with Electronic Health Records Enables Accurate Discharge QAJustice Ou, Tinglin Huang, Yilun Zhao, Ziyang Yu et al.ACL 2026 · 9 citations
- To Generate or to Retrieve? On the Effectiveness of Artificial Contexts for Medical Open-Domain Question AnsweringGiacomo Frisoni, Alessio Cocchieri, Alex Presepi, Gianluca Moro et al.ACL 2024 · 8 citations
- MIRA: A Novel Framework for Fusing Modalities in Medical RAGJinhong Wang, Tajamul Ashraf, Zongyan Han, Jorma Laaksonen et al.ACM MM 2025 · 5 citations
- Incentivizing Retrieval-Augmented Generation via Inner Adaptive Context SelectionChenxu Cui, Lin Shen, Haihui Fan, Sa Zhu et al.SIGIR 2026
