Lune

EMNLP Findings2020

AutoETER: Automated Entity Type Representation with Relation-Aware Attention for Knowledge Graph Embedding

Guanglin Niu, Bo Li, Yongfei Zhang, Shiliang Pu, Jingyang Li

Abstract

Recent advances in Knowledge Graph Embedding (KGE) allow for representing entities and relations in continuous vector spaces. Some traditional KGE models leveraging additional type information can improve the representation of entities which however totally rely on the explicit types or neglect the diverse type representations specific to various relations. Besides, none of the existing methods is capable of inferring all the relation patterns of symmetry, inversion and composition as well as the complex properties of 1-N, N-1 and N-N relations, simultaneously. To explore the type information for any KG, we develop a novel KGE framework with Automated Entity TypE Representation (AutoETER), which learns the latent type embedding of each entity by regarding each relation as a translation operation between the types of two entities with a relationaware projection mechanism. Particularly, our designed automated type representation learning mechanism is a pluggable module which can be easily incorporated with any KGE model. Besides, our approach could model and infer all the relation patterns and complex relations. Experiments on four datasets demonstrate the superior performance of our model compared to state-of-the-art baselines on link prediction tasks, and the visualization of type clustering provides clearly the explanation of type embeddings and verifies the effectiveness of our model.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Builds on1

  1. Rule-Guided Compositional Representation Learning on Knowledge GraphsGuanglin Niu, Yongfei Zhang, Bo Li, Peng Cui et al.AAAI 2020 · 70 citations

Related papers

  1. Rot-Pro: Modeling Transitivity by Projection in Knowledge Graph EmbeddingTengwei Song, Jie Luo, Lei HuangNeurIPS 2021 · 46 citations
  2. TranS: Transition-based Knowledge Graph Embedding with Synthetic Relation RepresentationXuanyu Zhang, Qing Yang, Dongliang XuEMNLP Findings 2022 · 14 citations
  3. PairRE: Knowledge Graph Embeddings via Paired Relation VectorsLinlin Chao, Jianshan He, Taifeng Wang, Wei ChuACL 2021
  4. MQuadE: a Unified Model for Knowledge Fact EmbeddingJinxing Yu, Yunfeng Cai, Mingming Sun, Ping LiWWW 2021 · 18 citations
  5. Learning Hierarchy-Aware Knowledge Graph Embeddings for Link PredictionZhanqiu Zhang, Jianyu Cai, Yongdong Zhang, Jie WangAAAI 2020 · 481 citations
Dusk over the sea between two cliffs drawn in fine vertical lines