EMNLP Findings2025
A Zero-Shot Neuro-Symbolic Approach for Complex Knowledge Graph Question Answering
Prerna Agarwal, Srikanta Bedathur
Abstract
Existing low-resource Knowledge Graph Question Answering (KGQA) methods rely heavily on Large Language Models (LLMs) for semantic parsing of natural language question to its corresponding logical form (LF) such as SPARQL, S-Expression, etc. However, LLMs becomes bottleneck for practical applications due to: (1) its high computational resource requirements; (2) limited knowledge of LLM about different LFs; (3) unavailability of lowresource annotated data for new KGs and settings. This motivates us to design a KGQA framework that can operate in a zero-shot setting without the need for additional resources. In this paper, we propose (NS-KGQA) 1 : a zeroshot neuro-symbolic approach based on neural KG embeddings that have demonstrated their ability to effectively model the structure of the KG without the need for additional data. We extract a link-prediction based symbolic question subgraph. We then propose a Symbolic Resolver that uses Dual KG Embeddings combined with a symbolic approach to resolve the symbolic question subgraph. Our extensive experiments on Complex KGQA benchmarks such as KQA Pro demonstrate the effectiveness of our approach. NS-KGQA outperforms all other LLM-based zero-shot baselines by 26% (avg).
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Builds on23
- Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
- Improving Multi-hop Question Answering over Knowledge Graphs using Knowledge Base EmbeddingsApoorv Saxena, Aditay Tripathi, Partha P. TalukdarACL 2020 · 488 citations
- Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge BasesYu Gu, Sue Kase, Michelle Vanni, Brian M. Sadler et al.WWW 2021 · 304 citations
- Subgraph Retrieval Enhanced Model for Multi-hop Knowledge Base Question AnsweringJing Zhang, Xiaokang Zhang, Jifan Yu, Jian Tang et al.ACL 2022 · 221 citations
- Sequence-to-Sequence Knowledge Graph Completion and Question AnsweringApoorv Saxena, Adrian Kochsiek, Rainer GemullaACL 2022 · 183 citations
Related papers
- SymKGQA: Few-Shot Knowledge Graph Question Answering via Symbolic Program Generation and ExecutionPrerna Agarwal, Nishant Kumar, Srikanta BedathurACL 2024 · 6 citations
- Neural-Symbolic Entangled Framework for Complex Query AnsweringZezhong Xu, Wen Zhang, Peng Ye, Hui Chen et al.NeurIPS 2022 · 31 citations
- Logical Message Passing Networks with One-hop Inference on Atomic FormulasZihao Wang, Yangqiu Song, Ginny Y. Wong, Simon SeeICLR 2023 · 4 citations
- Leveraging Abstract Meaning Representation for Knowledge Base Question AnsweringPavan Kapanipathi, Ibrahim Abdelaziz, Srinivas Ravishankar, Salim Roukos et al.ACL Findings 2021 · 85 citations
- LightPROF: A Lightweight Reasoning Framework for Large Language Model on Knowledge GraphTu Ao, Yanhua Yu, Yuling Wang, Yang Deng et al.AAAI 2025 · 28 citations
