Lune

ACL Findings2026

Iterative Knowledge Graph Refinement and Integration for Medical Question Answering

Haochen Zou, Yongli Wang

Abstract

Large Language Models (LLMs) are challenged by generating hallucinations and factually incorrect responses, particularly in complex and specialized medical question answering (QA). Integrating knowledge graphs (KGs) through retrieval-augmented generation (RAG) methods has emerged as a promising direction. However, existing graph-based RAG methods heuristically retrieve and refine questionrelevant subgraphs, potentially introducing redundant and noisy factual information that is difficult for LLMs to process, ultimately limiting reasoning capability. To incorporate a concise yet informative evidence subgraph, we propose an iterative medical QA framework. It optimizes graph-based RAG methods by selectively retrieving focused knowledge from KGs to construct a precise evidence subgraph and progressively pruning it utilizing structured feature representations. The targeted KG integration maintains coherent and reliable inference. Experiments on three medical QA benchmark datasets demonstrate that the framework achieves state-of-the-art performance against representative baseline competitors, highlighting the importance of efficient KG integration.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · related work

Get the answer

Free to start. No credit card required.

Builds on17

  1. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  2. Measuring Massive Multitask Language UnderstandingDan Hendrycks, Collin Burns, Steven Basart, Andy Zou et al.ICLR 2021 · 7,905 citations
  3. Benchmarking Retrieval-Augmented Generation for MedicineGuangzhi Xiong, Qiao Jin, Zhiyong Lu, Aidong ZhangACL Findings 2024 · 312 citations
  4. BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical DomainsYanis Labrak, Adrien Bazoge, Emmanuel Morin, Pierre-Antoine Gourraud et al.ACL Findings 2024 · 271 citations
  5. ReaRev: Adaptive Reasoning for Question Answering over Knowledge GraphsCostas Mavromatis, George KarypisEMNLP Findings 2022 · 30 citations

Related papers

  1. Leveraging Knowledge Graph-Enhanced LLMs for Context-Aware Medical ConsultationSu-Hyeong Park, Ho-Beom Kim, Seong-Jin Park, Dinara Aliyeva et al.EMNLP 2025
  2. ProgRAG: Hallucination-Resistant Progressive Retrieval and Reasoning over Knowledge GraphsMinbae Park, Hyemin Yang, Jeonghyun Kim, Kunsoo Park et al.AAAI 2026
  3. Empowering GraphRAG with Knowledge Filtering and IntegrationKai Guo, Harry Shomer, Shenglai Zeng, Haoyu Han et al.EMNLP 2025 · 2 citations
  4. Agentic Medical Knowledge Graphs Enhance Medical Question Answering: Bridging the Gap Between LLMs and Evolving Medical KnowledgeMohammad R. Rezaei, Reza Saadati Fard, Jayson Parker, Rahul G. Krishnan et al.EMNLP Findings 2025 · 14 citations
  5. Debate on Graph: A Flexible and Reliable Reasoning Framework for Large Language ModelsJie Ma, Zhitao Gao, Qi Chai, Wangchun Sun et al.AAAI 2025 · 8 citations
Dusk over the sea between two cliffs drawn in fine vertical lines