Enhancing Complex Question Answering over Knowledge Graphs through Evidence Pattern Retrieval
Wentao Ding, Jinmao Li, Liangchuan Luo, Yuzhong Qu
Abstract
Information retrieval (IR) methods for KGQA consist of two stages: subgraph extraction and answer reasoning. We argue current subgraph extraction methods underestimate the importance of structural dependencies among evidence facts. We propose Evidence Pattern Retrieval (EPR) to explicitly model the structural dependencies during subgraph extraction. We implement EPR by indexing the atomic adjacency pattern of resource pairs. Given a question, we perform dense retrieval to obtain atomic patterns formed by resource pairs. We then enumerate their combinations to construct candidate evidence patterns. These evidence patterns are scored using a neural model, and the best one is selected to extract a subgraph for downstream answer reasoning. Experimental results demonstrate that the EPR-based approach has significantly improved the F1 scores of IR-KGQA methods by over 10 points on ComplexWebQuestions and achieves competitive performance on WebQuestionsSP. CCS CONCEPTS • Information systems → Question answering.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 15ec9d02-6a4b-467f-b5bf-57d108bb8539Cited by top-tier papers14
- SymAgent: A Neural-Symbolic Self-Learning Agent Framework for Complex Reasoning over Knowledge GraphsBen Liu, Jihai Zhang, Fangquan Lin, Cheng Yang et al.WWW 2025 · 21 citations
- MultiRAG: A Knowledge-Guided Framework for Mitigating Hallucination in Multi-Source Retrieval Augmented GenerationWenlong Wu, Haofen Wang, Bohan Li, Peixuan Huang et al.ICDE 2025 · 16 citations
- ReMindRAG: Low-Cost LLM-Guided Knowledge Graph Traversal for Efficient RAGYikuan Hu, Jifeng Zhu, Lanrui Tang, Chen HuangNeurIPS 2025 · 10 citations
- EPERM: An Evidence Path Enhanced Reasoning Model for Knowledge Graph Question and AnsweringXiao Long, Liansheng Zhuang, Aodi Li, Minghong Yao et al.AAAI 2025 · 10 citations
- CoTKR: Chain-of-Thought Enhanced Knowledge Rewriting for Complex Knowledge Graph Question AnsweringYike Wu, Yi Huang, Nan Hu, Yuncheng Hua et al.EMNLP 2024 · 9 citations
Builds on15
- Improving Multi-hop Question Answering over Knowledge Graphs using Knowledge Base EmbeddingsApoorv Saxena, Aditay Tripathi, Partha P. TalukdarACL 2020 · 488 citations
- Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge BasesYu Gu, Sue Kase, Michelle Vanni, Brian M. Sadler et al.WWW 2021 · 304 citations
- Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question AnsweringJing Zhang, Xiaokang Zhang, Jifan Yu, Jian Tang et al.ACL 2022 · 221 citations
- RNG-KBQA: Generation Augmented Iterative Ranking for Knowledge Base Question AnsweringXi Ye, Semih Yavuz, Kazuma Hashimoto, Yingbo Zhou et al.ACL 2022 · 203 citations
- FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question AnsweringZhenyu Li, Sunqi Fan, Yu Gu, Xiuxing Li et al.AAAI 2024 · 143 citations
Related papers
- SSR: Structured Subgraph Retrieval for Temporal Knowledge Graph Question Answering with LLMsYing Zhang, Li Zhang, Wenya Guo, Shilong Ping et al.SIGIR 2026
- Temporal Evidence Chain for Temporal Knowledge Graph Question Answering with Large Language ModelsShihao Liu, Xiaofei Zhou, Bo Wang, Geyuan ZhangACL 2026
- STEM: Structure-Tracing Evidence Mining for Knowledge Graphs-Driven Retrieval-Augmented GenerationPeng Yu, En Xu, Bin Chen, Haibiao Chen et al.ACL 2026
- COSMOS: Connectivity-Oriented Submodular Maximization for Optimal Subgraph RetrievalBoci Peng, Xiao Liu, Boren Hu, Yun Zhu et al.ACL 2026
- Knowledge Base Question Answering by Case-based Reasoning over SubgraphsRajarshi Das, Ameya Godbole, Ankita Naik, Elliot Tower et al.ICML 2022 · 66 citations
