Lune

EMNLP Findings2024

Retrieval and Reasoning on KGs: Integrate Knowledge Graphs into Large Language Models for Complex Question Answering

Yixin Ji, Kaixin Wu, Juntao Li, Wei Chen, Mingjie Zhong, Jia Xu, Min Zhang

Abstract

Despite Large Language Models (LLMs) have performed impressively in various Natural Language Processing (NLP) tasks, their inherent hallucination phenomena severely challenge their credibility in complex reasoning. Combining explainable Knowledge Graphs (KGs) with LLMs is a promising path to address this issue. However, structured KGs are difficult to utilize, and how to make LLMs understand and incorporate them is a challenging topic. We thereby reorganize a more efficient structure of KGs, while designing the KG-related instruction tuning and continual pre-training strategies to enable LLMs to learn and internalize this form of representation effectively. Moreover, we construct subgraphs to further enhance the retrieval capabilities of KGs via CoT reasoning. Extensive experiments on two KGQA datasets demonstrate that our model achieves convincing performance compared to strong baselines 1 .

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

8 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Deliberation on Priors: Trustworthy Reasoning of Large Language Models on Knowledge Graphs cites Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning
  • Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoning cites Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
  • AtlasKV: Augmenting LLMs with Billion-Scale Knowledge Graphs in 20GB VRAM cites Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers8

  1. Deliberation on Priors: Trustworthy Reasoning of Large Language Models on Knowledge GraphsJie Ma, Ning Qu, Zhitao Gao, Rui Xing et al.NeurIPS 2025 · 9 citations
  2. AtlasKV: Augmenting LLMs with Billion-Scale Knowledge Graphs in 20GB VRAMHaoyu Huang, Hong Ting Tsang, Jiaxin Bai, Xi Peng et al.ICLR 2026 · 4 citations
  3. Enhancing Agentic Textual Graph Retrieval with Synthetic Stepwise SupervisionGe Chang, Jinbo Su, Jiacheng Liu, Pengfei Yang et al.ACL 2026 · 1 citation
  4. NOTAM-Evolve: A Knowledge-Guided Self-Evolving Optimization Framework with LLMs for NOTAM InterpretationMaoqi Liu, Quan Fang, Yuhao Wu, Can Zhao et al.AAAI 2026 · 1 citation
  5. Taming the Untamed: Graph-Based Knowledge Retrieval and Reasoning for MLLMs to Conquer the UnknownBowen Wang, Zhouqiang Jiang, Yasuaki Susumu, Shotaro Miwa et al.ICCV 2025 · 1 citation

Builds on17

  1. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma et al.NeurIPS 2022 · 22,562 citations
  2. Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksPatrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni et al.NeurIPS 2020 · 19,162 citations
  3. Efficient Memory Management for Large Language Model Serving with PagedAttentionWoosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng et al.SOSP 2023 · 1,016 citations
  4. K-BERT: Enabling Language Representation with Knowledge GraphWeijie Liu, Peng Zhou, Zhe Zhao, Zhiruo Wang et al.AAAI 2020 · 898 citations
  5. Reasoning on Graphs: Faithful and Interpretable Large Language Model ReasoningLinhao Luo, Yuan-Fang Li, Gholamreza Haffari, Shirui PanICLR 2024 · 499 citations

Related papers

  1. ProgRAG: Hallucination-Resistant Progressive Retrieval and Reasoning over Knowledge GraphsMinbae Park, Hyemin Yang, Jeonghyun Kim, Kunsoo Park et al.AAAI 2026
  2. Thought-Action Graph Reasoning: Faithful and Efficient Reasoning of Large Language Models via Reusing Past ExperienceZhixiao Qi, Feng Huang, Yunqi Zhang, Shijie Zhang et al.ACL Findings 2026
  3. Explore-on-Graph: Incentivizing Autonomous Exploration of Large Language Models on Knowledge Graphs with Path-refined Reward ModelingShiqi Yan, Yubo Chen, Ruiqi Zhou, Zhengxi Yao et al.ICLR 2026 · 3 citations
  4. MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language ModelsYilin Wen, Zifeng Wang, Jimeng SunACL 2024 · 74 citations
  5. Knowledge Reasoning Language Model: Unifying Knowledge and Language for Inductive Knowledge Graph ReasoningXingrui Zhuo, Jiapu Wang, Gongqing Wu, Zhongyuan Wang et al.ICLR 2026 · 2 citations
Dusk over the sea between two cliffs drawn in fine vertical lines