Knowledge Base Question Answering by Case-based Reasoning over Subgraphs
Rajarshi Das, Ameya Godbole, Ankita Naik, Elliot Tower, Manzil Zaheer, Hannaneh Hajishirzi, Robin Jia, Andrew McCallum
Abstract
Question answering (QA) over knowledge bases (KBs) is challenging because of the diverse, essentially unbounded, types of reasoning patterns needed. However, we hypothesize in a large KB, reasoning patterns required to answer a query type reoccur for various entities in their respective subgraph neighborhoods. Leveraging this structural similarity between local neighborhoods of different subgraphs, we introduce a semiparametric model (CBR-SUBG) with (i) a nonparametric component that for each query, dynamically retrieves other similar -nearest neighbor (KNN) training queries along with query-specific subgraphs and (ii) a parametric component that is trained to identify the (latent) reasoning patterns from the subgraphs of KNN queries and then apply them to the subgraph of the target query. We also propose an adaptive subgraph collection strategy to select a query-specific compact subgraph, allowing us to scale to full Freebase KB containing billions of facts. We show that CBR-SUBG can answer queries requiring subgraph reasoning patterns and performs competitively with the best models on several KBQA benchmarks. Our subgraph collection strategy also produces more compact subgraphs (e.g. 55% reduction in size for WebQSP while increasing answer recall by 4.85%).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4c48fa67-ea7e-43ab-9c3c-72553ad4998eCited by top-tier papers11
- Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question AnsweringZiniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang et al.EMNLP 2022 · 32 citations
- NuTrea: Neural Tree Search for Context-guided Multi-hop KGQAHyeong Kyu Choi, Seunghun Lee, Jaewon Chu, Hyunwoo J. KimNeurIPS 2023 · 20 citations
- DecAF: Joint Decoding of Answers and Logical Forms for Question Answering over Knowledge BasesDonghan Yu, Sheng Zhang, Patrick Ng, Henghui Zhu et al.ICLR 2023 · 18 citations
- UniBind: LLM-Augmented Unified and Balanced Representation Space to Bind Them AllYuanhuiyi Lyu, Xu Zheng, Jiazhou Zhou, Lin WangCVPR 2024 · 8 citations
- Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge GraphsJia Ao Sun, Hao Yu, Fabrizio Gotti, Fengran Mo et al.KDD 2026 · 8 citations
Builds on14
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 1,663 citations
- Generalization through Memorization: Nearest Neighbor Language ModelsUrvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer et al.ICLR 2020 · 1,038 citations
- InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information MaximizationFan-Yun Sun, Jordan Hoffmann, Vikas Verma, Jian TangICLR 2020 · 1,010 citations
Related papers
- Case-based Reasoning for Natural Language Queries over Knowledge BasesRajarshi Das, Manzil Zaheer, Dung Thai, Ameya Godbole et al.EMNLP 2021 · 111 citations
- ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge GraphJinhao Jiang, Kun Zhou, Wayne Xin Zhao, Yaliang Li et al.EMNLP 2023 · 26 citations
- SQALER: Scaling Question Answering by Decoupling Multi-Hop and Logical ReasoningMattia Atzeni, Jasmina Bogojeska, Andreas LoukasNeurIPS 2021 · 21 citations
- Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question AnsweringJing Zhang, Xiaokang Zhang, Jifan Yu, Jian Tang et al.ACL 2022 · 221 citations
- SSR: Structured Subgraph Retrieval for Temporal Knowledge Graph Question Answering with LLMsYing Zhang, Li Zhang, Wenya Guo, Shilong Ping et al.SIGIR 2026
