Lune

ACL Findings2021

Injecting Knowledge Base Information into End-to-End Joint Entity and Relation Extraction and Coreference Resolution

Severine Verlinden, Klim Zaporojets, Johannes Deleu, Thomas Demeester, Chris Develder

Abstract

We consider a joint information extraction (IE) model, solving named entity recognition, coreference resolution and relation extraction jointly over the whole document. In particular, we study how to inject information from a knowledge base (KB) in such IE model, based on unsupervised entity linking. The used KB entity representations are learned from either (i) hyperlinked text documents (Wikipedia), or (ii) a knowledge graph (Wikidata), and appear complementary in raising IE performance. Representations of corresponding entity linking (EL) candidates are added to text span representations of the input document, and we experiment with (i) taking a weighted average of the EL candidate representations based on their prior (in Wikipedia), and (ii) using an attention scheme over the EL candidate list. Results demonstrate an increase of up to 5% F1-score for the evaluated IE tasks on two datasets. Despite a strong performance of the prior-based model, our quantitative and qualitative analysis reveals the advantage of using the attention-based approach.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

5 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • A Symbolic Rule Integration Framework with Logic Transformer for Inductive Relation Prediction cites Inductive Relation Prediction with Logical Reasoning Using Contrastive Representations
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers5

  1. A Novel Table-to-Graph Generation Approach for Document-Level Joint Entity and Relation ExtractionRuoyu Zhang, Yanzeng Li, Lei ZouACL 2023 · 20 citations
  2. Inductive Relation Prediction with Logical Reasoning Using Contrastive RepresentationsYudai Pan, Jun Liu, Lingling Zhang, Tianzhe Zhao et al.EMNLP 2022 · 18 citations
  3. Revisiting Document-Level Relation Extraction with Context-Guided Link PredictionMonika Jain, Raghava Mutharaju, Ramakanth Kavuluru, Kuldeep SinghAAAI 2024 · 17 citations
  4. Few-Shot Joint Multimodal Entity-Relation Extraction via Knowledge-Enhanced Cross-modal Prompt ModelLi Yuan, Yi Cai, Junsheng HuangACM MM 2024 · 9 citations
  5. A Symbolic Rule Integration Framework with Logic Transformer for Inductive Relation PredictionYudai Pan, Jun Liu, Tianzhe Zhao, Lingling Zhang et al.WWW 2024 · 3 citations

Builds on3

  1. K-BERT: Enabling Language Representation with Knowledge GraphWeijie Liu, Peng Zhou, Zhe Zhao, Zhiruo Wang et al.AAAI 2020 · 898 citations
  2. LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentionIkuya Yamada, Akari Asai, Hiroyuki Shindo, Hideaki Takeda et al.EMNLP 2020 · 562 citations
  3. E-BERT: Efficient-Yet-Effective Entity Embeddings for BERTNina Pörner, Ulli Waltinger, Hinrich SchützeEMNLP Findings 2020 · 146 citations

Related papers

  1. Knowledge-Graph Augmented Word Representations for Named Entity RecognitionQizhen He, Liang Wu, Yida Yin, Heming CaiAAAI 2020 · 30 citations
  2. Improving Entity Linking by Modeling Latent Entity Type InformationShuang Chen, Jinpeng Wang, Feng Jiang, Chin-Yew LinAAAI 2020 · 71 citations
  3. Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective InferenceTuan Manh Lai, Heng Ji, ChengXiang Zhai, Quan Hung TranACL 2021
  4. Exploiting Structured Knowledge in Text via Graph-Guided Representation LearningTao Shen, Yi Mao, Pengcheng He, Guodong Long et al.EMNLP 2020 · 60 citations
  5. RAED: Retrieval-Augmented Entity Description Generation for Emerging Entity Linking and DisambiguationKarim Ghonim, Pere-Lluís Huguet Cabot, Riccardo Orlando, Roberto NavigliEMNLP 2025
Dusk over the sea between two cliffs drawn in fine vertical lines