KARMA: Leveraging Multi-Agent LLMs for Automated Knowledge Graph Enrichment
Yuxing Lu, Wei Wu, Xukai Zhao, Rui Peng, Jinzhuo Wang
Abstract
Maintaining comprehensive and up-to-date knowledge graphs (KGs) is critical for modern AI systems, but manual curation struggles to scale with the rapid growth of scientific literature. This paper presents KARMA, a novel framework employing multi-agent large language models (LLMs) to automate KG enrichment through structured analysis of unstructured text. Our approach employs nine collaborative agents, spanning entity discovery, relation extraction, schema alignment, and conflict resolution that iteratively parse documents, verify extracted knowledge, and integrate it into existing graph structures while adhering to domain-specific schema. Experiments on 1,200 PubMed articles from three different domains demonstrate the effectiveness of KARMA in knowledge graph enrichment, with the identification of up to 38,230 new entities while achieving 83.1% LLM-verified correctness and reducing conflict edges by 18.6% through multi-layer assessments.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f81d107b-e936-4327-b29b-c93113a5554cCited by top-tier papers2
- Constructing coherent spatial memory in LLM agents through graph rectificationPuzhen Zhang, Xuyang Chen, Yu Feng, Yuhan Jiang et al.ACL 2026 · 2 citations
- LLMs as Knowledge Graph Refiners: Mitigating Factual Inconsistencies in Generative Knowledge ExtractionDonghyun Kim, Hyeongjun Yang, Seokju Hwang, Kyong-Ho Lee et al.ACL 2026
Builds on3
- Training language models to follow instructions with human feedbackLong Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida et al.NeurIPS 2022 · 24,707 citations
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language ModelsPotsawee Manakul, Adian Liusie, Mark J. F. GalesEMNLP 2023 · 331 citations
- Encouraging Divergent Thinking in Large Language Models through Multi-Agent DebateTian Liang, Zhiwei He, Wenxiang Jiao, Xing Wang et al.EMNLP 2024 · 177 citations
Related papers
- Entity Alignment with Noisy Annotations from Large Language ModelsShengyuan Chen, Qinggang Zhang, Junnan Dong, Wen Hua et al.NeurIPS 2024 · 44 citations
- HLMEA: Unsupervised Entity Alignment Based on Hybrid Language ModelsXiongnan Jin, Zhilin Wang, Jinpeng Chen, Liu Yang et al.AAAI 2025 · 5 citations
- Mixture of Knowledge Minigraph Agents for Literature Review GenerationZhi Zhang, Yan Liu, Sheng-hua Zhong, Gong Chen et al.AAAI 2025 · 1 citation
- Knowledge-Aware Co-Reasoning for Multidisciplinary CollaborationXurui Li, Wanghaijiao, Kaisong Song, Rui Zhu et al.EMNLP 2025
- KARL: Reinforcement Learning for LLM Agents on Multi-Turn Knowledge-Intensive Agentic TasksXueqiao Sun, Xiao Liu, Bowen Lv, Hanchen Zhang et al.ACL 2026
