Toward Degree Bias in Embedding-Based Knowledge Graph Completion
Harry Shomer, Wei Jin, Wentao Wang, Jiliang Tang
Abstract
A fundamental task for knowledge graphs (KGs) is knowledge graph completion (KGC). It aims to predict unseen edges by learning representations for all the entities and relations in a KG. A common concern when learning representations on traditional graphs is degree bias. It can affect graph algorithms by learning poor representations for lower-degree nodes, often leading to low performance on such nodes. However, there has been limited research on whether there exists degree bias for embedding-based KGC and how such bias affects the performance of KGC. In this paper, we validate the existence of degree bias in embedding-based KGC and identify the key factor to degree bias. We then introduce a novel data augmentation method, KG-Mixup, to generate synthetic triples to mitigate such bias. Extensive experiments have demonstrated that our method can improve various embedding-based KGC methods and outperform other methods tackling the bias problem on multiple benchmark datasets. 1 CCS CONCEPTS • Computing methodologies → Knowledge representation and reasoning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b98a3c6b-c3db-44da-8892-5f862dde7d83Cited by top-tier papers6
- Theoretical and Empirical Insights into the Origins of Degree Bias in Graph Neural NetworksArjun Subramonian, Jian Kang, Yizhou SunNeurIPS 2024 · 15 citations
- Subgraph-Aware Training of Language Models for Knowledge Graph Completion Using Structure-Aware Contrastive LearningYoumin Ko, Hyemin Yang, Taeuk Kim, Hyunjoon KimWWW 2025 · 10 citations
- Networked Inequality: Preferential Attachment Bias in Graph Neural Network Link PredictionArjun Subramonian, Levent Sagun, Yizhou SunICML 2024 · 8 citations
- DIVE: Subgraph Disagreement for Graph Out-of-Distribution GeneralizationXin Sun, Liang Wang, Qiang Liu, Shu Wu et al.KDD 2024 · 6 citations
- Towards Pattern-aware Data Augmentation for Temporal Knowledge Graph CompletionJiasheng Zhang, Deqiang Ouyang, Shuang Liang, Jie ShaoVLDB 2025
Builds on15
- K-BERT: Enabling Language Representation with Knowledge GraphWeijie Liu, Peng Zhou, Zhe Zhao, Zhiruo Wang et al.AAAI 2020 · 898 citations
- Balanced Meta-Softmax for Long-Tailed Visual RecognitionJiawei Ren, Cunjun Yu, Shunan Sheng, Xiao Ma et al.NeurIPS 2020 · 861 citations
- Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link PredictionZhaocheng Zhu, Zuobai Zhang, Louis-Pascal A. C. Xhonneux, Jian TangNeurIPS 2021 · 546 citations
- Data Augmentation for Graph Neural NetworksTong Zhao, Yozen Liu, Leonardo Neves, Oliver J. Woodford et al.AAAI 2021 · 487 citations
- Long-tailed Recognition by Routing Diverse Distribution-Aware ExpertsXudong Wang, Long Lian, Zhongqi Miao, Ziwei Liu et al.ICLR 2021 · 481 citations
Related papers
- GraphPatcher: Mitigating Degree Bias for Graph Neural Networks via Test-time AugmentationMingxuan Ju, Tong Zhao, Wenhao Yu, Neil Shah et al.NeurIPS 2023 · 52 citations
- Towards Global-Topology Relation Graph for Inductive Knowledge Graph CompletionLing Ding, Lei Huang, Zhizhi Yu, Di Jin et al.AAAI 2025 · 8 citations
- Conditional Diffusion Guided Knowledge Transfer for Multi-Domain Knowledge Graph CompletionJiawei Sheng, Taoyu Su, Xixun Lin, Xiaodong Li et al.WWW 2026
- Knowledge Graph Completion with Counterfactual AugmentationHeng Chang, Jie Cai, Jia LiWWW 2023 · 36 citations
- Mining Implicit Entity Preference from User-Item Interaction Data for Knowledge Graph Completion via Adversarial LearningGaole He, Junyi Li, Wayne Xin Zhao, Peiju Liu et al.WWW 2020 · 43 citations
