PairRE: Knowledge Graph Embeddings via Paired Relation Vectors
Linlin Chao, Jianshan He, Taifeng Wang, Wei Chu
Abstract
Distance based knowledge graph embedding methods show promising results on link prediction task, on which two topics have been widely studied: one is the ability to handle complex relations, such as N-to-1, 1-to-N and N-to-N, the other is to encode various relation patterns, such as symmetry/antisymmetry. However, the existing methods fail to solve these two problems at the same time, which leads to unsatisfactory results. To mitigate this problem, we propose PairRE, a model with paired vectors for each relation representation. The paired vectors enable an adaptive adjustment of the margin in loss function to fit for complex relations. Besides, PairRE is capable of encoding three important relation patterns, symmetry/antisymmetry, inverse and composition. Given simple constraints on relation representations, PairRE can encode subrelation further. Experiments on link prediction benchmarks demonstrate the proposed key capabilities of PairRE. Moreover, We set a new stateof-the-art on two knowledge graph datasets of the challenging Open Graph Benchmark.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 07547744-ab13-4f06-86e1-d6a2487810c7Cited by top-tier papers28
- Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link PredictionZhaocheng Zhu, Zuobai Zhang, Louis-Pascal A. C. Xhonneux, Jian TangNeurIPS 2021 · 546 citations
- HittER: Hierarchical Transformers for Knowledge Graph EmbeddingsSanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao et al.EMNLP 2021 · 110 citations
- How Does Knowledge Graph Embedding Extrapolate to Unseen Data: A Semantic Evidence ViewRen Li, Yanan Cao, Qiannan Zhu, Guanqun Bi et al.AAAI 2022 · 103 citations
- A*Net: A Scalable Path-based Reasoning Approach for Knowledge GraphsZhaocheng Zhu, Xinyu Yuan, Michael Galkin, Louis-Pascal A. C. Xhonneux et al.NeurIPS 2023 · 103 citations
- Relation-enhanced Negative Sampling for Multimodal Knowledge Graph CompletionDerong Xu, Tong Xu, Shiwei Wu, Jingbo Zhou et al.ACM MM 2022 · 89 citations
Builds on3
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Orthogonal Relation Transforms with Graph Context Modeling for Knowledge Graph EmbeddingYun Tang, Jing Huang, Guangtao Wang, Xiaodong He et al.ACL 2020 · 92 citations
- SEEK: Segmented Embedding of Knowledge GraphsWentao Xu, Shun Zheng, Liang He, Bin Shao et al.ACL 2020 · 31 citations
Related papers
- MQuadE: a Unified Model for Knowledge Fact EmbeddingJinxing Yu, Yunfeng Cai, Mingming Sun, Ping LiWWW 2021 · 18 citations
- TranSHER: Translating Knowledge Graph Embedding with Hyper-Ellipsoidal RestrictionYizhi Li, Wei Fan, Chao Liu, Chenghua Lin et al.EMNLP 2022 · 7 citations
- MQuinE: a Cure for "Z-paradox" in Knowledge Graph EmbeddingYang Liu, Huang Fang, Yunfeng Cai, Mingming SunEMNLP 2024
- Poisoning Knowledge Graph Embeddings via Relation Inference PatternsPeru Bhardwaj, John D. Kelleher, Luca Costabello, Declan O'SullivanACL 2021
- Rot-Pro: Modeling Transitivity by Projection in Knowledge Graph EmbeddingTengwei Song, Jie Luo, Lei HuangNeurIPS 2021 · 46 citations
