Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question Answering
Jing Zhang, Xiaokang Zhang, Jifan Yu, Jian Tang, Jie Tang, Cuiping Li, Hong Chen
Abstract
Recent works on knowledge base question answering (KBQA) retrieve subgraphs for easier reasoning. The desired subgraph is crucial as a small one may exclude the answer but a large one might introduce more noises. However, the existing retrieval is either heuristic or interwoven with the reasoning, causing reasoning on the partial subgraphs, which increases the reasoning bias when the intermediate supervision is missing. This paper proposes a trainable subgraph retriever (SR) decoupled from the subsequent reasoning process, which enables a plug-and-play framework to enhance any subgraph-oriented KBQA model. Extensive experiments demonstrate SR achieves significantly better retrieval and QA performance than existing retrieval methods. Via weakly supervised pre-training as well as the end-to-end fine-tuning, SR achieves new state-of-the-art performance when combined with NSM (He et al., 2021), a subgraph-oriented reasoner, for embedding-based KBQA methods. Codes and datasets are available online (https://github.com/RUCKBReasoning/SubgraphRetrievalKBQA)
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c8c43241-5a64-4de4-89bc-fdb7fd52b227Cited by top-tier papers49
- Reasoning on Graphs: Faithful and Interpretable Large Language Model ReasoningLinhao Luo, Yuan-Fang Li, Gholamreza Haffari, Shirui PanICLR 2024 · 499 citations
- TECHS: Temporal Logical Graph Networks for Explainable Extrapolation ReasoningQika Lin, Jun Liu, Rui Mao, Fangzhi Xu et al.ACL 2023 · 48 citations
- MINES: Message Intercommunication for Inductive Relation Reasoning over Neighbor-Enhanced SubgraphsKe Liang, Lingyuan Meng, Sihang Zhou, Wenxuan Tu et al.AAAI 2024 · 41 citations
- TIARA: Multi-grained Retrieval for Robust Question Answering over Large Knowledge BaseYiheng Shu, Zhiwei Yu, Yuhan Li, Börje F. Karlsson et al.EMNLP 2022 · 39 citations
- Could Small Language Models Serve as Recommenders? Towards Data-centric Cold-start RecommendationXuansheng Wu, Huachi Zhou, Yucheng Shi, Wenlin Yao et al.WWW 2024 · 37 citations
Builds on8
- Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie et al.NeurIPS 2020 · 3,159 citations
- Retrieval Augmented Language Model Pre-TrainingKelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat et al.ICML 2020 · 2,937 citations
- Improving Multi-hop Question Answering over Knowledge Graphs using Knowledge Base EmbeddingsApoorv Saxena, Aditay Tripathi, Partha P. TalukdarACL 2020 · 488 citations
- Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question AnsweringAkari Asai, Kazuma Hashimoto, Hannaneh Hajishirzi, Richard Socher et al.ICLR 2020 · 322 citations
- SPARQA: Skeleton-Based Semantic Parsing for Complex Questions over Knowledge BasesYawei Sun, Lingling Zhang, Gong Cheng, Yuzhong QuAAAI 2020 · 143 citations
Related papers
- ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge GraphJinhao Jiang, Kun Zhou, Wayne Xin Zhao, Yaliang Li et al.EMNLP 2023 · 26 citations
- DSM: Question Generation over Knowledge Base via Modeling Diverse Subgraphs with Meta-learnerShasha Guo, Jing Zhang, Yanling Wang, Qianyi Zhang et al.EMNLP 2022 · 9 citations
- SSR: Structured Subgraph Retrieval for Temporal Knowledge Graph Question Answering with LLMsYing Zhang, Li Zhang, Wenya Guo, Shilong Ping et al.SIGIR 2026
- D-RAG: Differentiable Retrieval-Augmented Generation for Knowledge Graph Question AnsweringGuangze Gao, Zixuan Li, Chunfeng Yuan, Jiawei Li et al.EMNLP 2025
- UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge GraphJinhao Jiang, Kun Zhou, Xin Zhao, Ji-Rong WenICLR 2023 · 28 citations
