Lune

EMNLP Findings2023

KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completion

Yanbin Wei, Qiushi Huang, Yu Zhang, James T. Kwok

Abstract

Knowledge Graph Completion (KGC) is crucial for addressing knowledge graph incompleteness and supporting downstream applications. Many models have been proposed for KGC. They can be categorized into two main classes: triple-based and text-based approaches. Triple-based methods struggle with long-tail entities due to limited structural information and imbalanced entity distributions. Text-based methods alleviate this issue but require costly training for language models and specific finetuning for knowledge graphs, which limits their efficiency. To alleviate these limitations, in this paper, we propose KICGPT, a framework that integrates a large language model (LLM) and a triple-based KGC retriever. It alleviates the long-tail problem without incurring additional training overhead. KICGPT uses an in-context learning strategy called Knowledge Prompt, which encodes structural knowledge into demonstrations to guide the LLM. Empirical results on benchmark datasets demonstrate the effectiveness of KICGPT with smaller training overhead and no finetuning.

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 26 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers26

  1. GITA: Graph to Visual and Textual Integration for Vision-Language Graph ReasoningYanbin Wei, Shuai Fu, Weisen Jiang, Zejian Zhang et al.NeurIPS 2024 · 56 citations
  2. KG-FIT: Knowledge Graph Fine-Tuning Upon Open-World KnowledgePengcheng Jiang, Lang Cao, Cao (Danica) Xiao, Parminder Bhatia et al.NeurIPS 2024 · 40 citations
  3. Self-supervised Quantized Representation for Seamlessly Integrating Knowledge Graphs with Large Language ModelsQika Lin, Tianzhe Zhao, Kai He, Zhen Peng et al.ACL 2025 · 15 citations
  4. Knowledge Graph Completion with Relation-Aware Anchor EnhancementDuanyang Yuan, Sihang Zhou, Xiaoshu Chen, Dong Wang et al.AAAI 2025 · 12 citations
  5. Debate on Graph: A Flexible and Reliable Reasoning Framework for Large Language ModelsJie Ma, Zhitao Gao, Qi Chai, Wangchun Sun et al.AAAI 2025 · 8 citations

Builds on8

  1. Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
  2. Calibrate Before Use: Improving Few-shot Performance of Language ModelsZihao Zhao, Eric Wallace, Shi Feng, Dan Klein et al.ICML 2021 · 1,843 citations
  3. Composition-based Multi-Relational Graph Convolutional NetworksShikhar Vashishth, Soumya Sanyal, Vikram Nitin, Partha P. TalukdarICLR 2020 · 1,105 citations
  4. Learning Hierarchy-Aware Knowledge Graph Embeddings for Link PredictionZhanqiu Zhang, Jianyu Cai, Yongdong Zhang, Jie WangAAAI 2020 · 481 citations
  5. Compositional Exemplars for In-context LearningJiacheng Ye, Zhiyong Wu, Jiangtao Feng, Tao Yu et al.ICML 2023 · 188 citations

Related papers

  1. ATAP: Automatic Template-Augmented Commonsense Knowledge Graph Completion via Pre-Trained Language ModelsFu Zhang, Yifan Ding, Jingwei ChengEMNLP 2024 · 2 citations
  2. Knowledge Context Modeling with Pre-trained Language Models for Contrastive Knowledge Graph CompletionGuangqian Yang, Yi Liu, Lei Zhang, Licheng Zhang et al.ACL Findings 2024 · 9 citations
  3. DrKGC: Dynamic Subgraph Retrieval-Augmented LLMs for Knowledge Graph Completion across General and Biomedical DomainsYongkang Xiao, Sinian Zhang, Yi Dai, Huixue Zhou et al.EMNLP Findings 2025 · 6 citations
  4. GLTW: Joint Improved Graph Transformer and LLM via Three-Word Language for Knowledge Graph CompletionKangyang Luo, Yuzhuo Bai, Cheng Gao, Shuzheng Si et al.ACL Findings 2025 · 5 citations
  5. Making Large Language Models Perform Better in Knowledge Graph CompletionYichi Zhang, Zhuo Chen, Lingbing Guo, Yajing Xu et al.ACM MM 2024 · 86 citations
Dusk over the sea between two cliffs drawn in fine vertical lines