EMNLP Findings2022
Knowledge Graph Generation From Text
Igor Melnyk, Pierre L. Dognin, Payel Das
Abstract
In this work we propose a novel end-to-end multi-stage Knowledge Graph (KG) generation system from textual inputs, separating the overall process into two stages. The graph nodes are generated first using pretrained language model, followed by a simple edge construction head, enabling efficient KG extraction from the text. For each stage we consider several architectural choices that can be used depending on the available training resources. We evaluated the model on a recent WebNLG 2020 Challenge dataset, matching the state-of-the-art performance on text-to-RDF generation task, as well as on New York Times (NYT) and a largescale TEKGEN datasets, showing strong overall performance, outperforming the existing baselines. We believe that the proposed system can serve as a viable KG construction alternative to the existing linearization or sampling-based graph generation approaches.
Ask Lune
Ask anything. The answer quotes the paper.
Lune reads all of it and the papers around it, then shows you the passages behind every answer.
Lune answers from
the full paper · 6 top-tier papers that cite it · related work
Free to start. No credit card required.
Cited by top-tier papers6
- Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph ConstructionBowen Zhang, Harold SohEMNLP 2024 · 65 citations
- Any2Graph: Deep End-To-End Supervised Graph Prediction With An Optimal Transport LossPaul Krzakala, Junjie Yang, Rémi Flamary, Florence d'Alché-Buc et al.NeurIPS 2024 · 7 citations
- Mitigating Data Sparsity in Integrated Data through Text ConceptualizationMd. Ataur Rahman, Sergi Nadal, Oscar Romero, Dimitris SacharidisICDE 2024 · 3 citations
- DiffuCOMET: Contextual Commonsense Knowledge DiffusionSilin Gao, Mete Ismayilzada, Mengjie Zhao, Hiromi Wakaki et al.ACL 2024 · 2 citations
- HYPPO: Using Equivalences to Optimize Pipelines in Exploratory Machine LearningAntonios Kontaxakis, Dimitris Sacharidis, Alkis Simitsis, Alberto Abelló et al.ICDE 2024 · 1 citation
Builds on6
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad et al.ACL 2020 · 1,224 citations
- AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated PromptsTaylor Shin, Yasaman Razeghi, Robert L. Logan IV, Eric Wallace et al.EMNLP 2020 · 1,162 citations
- ReGen: Reinforcement Learning for Text and Knowledge Base Generation using Pretrained Language ModelsPierre L. Dognin, Inkit Padhi, Igor Melnyk, Payel DasEMNLP 2021 · 17 citations
- DualTKB: A Dual Learning Bridge between Text and Knowledge BasePierre L. Dognin, Igor Melnyk, Inkit Padhi, Cícero Nogueira dos Santos et al.EMNLP 2020 · 1 citation
- Prefix-Tuning: Optimizing Continuous Prompts for GenerationXiang Lisa Li, Percy LiangACL 2021
Related papers
- Discovering Latent Facts from Context to Construct Richer Open Knowledge GraphsJinpeng Li, Hang Yu, Ziqi Ma, Peng QiAAAI 2026
- KGGen: Extracting Knowledge Graphs from Plain Text with Language ModelsBelinda Mo, Kyssen Yu, Joshua Kazdan, Proud Mpala et al.NeurIPS 2025 · 84 citations
- Contrastive Triple Extraction with Generative TransformerHongbin Ye, Ningyu Zhang, Shumin Deng, Mosha Chen et al.AAAI 2021 · 146 citations
- Structure-aware Knowledge Graph-to-text Generation with Planning Selection and Similarity DistinctionFeng Zhao, Hongzhi Zou, Cheng YanEMNLP 2023 · 5 citations
- ENT-DESC: Entity Description Generation by Exploring Knowledge GraphLiying Cheng, Dekun Wu, Lidong Bing, Yan Zhang et al.EMNLP 2020 · 22 citations
