Rethinking Graph Convolutional Networks in Knowledge Graph Completion
Zhanqiu Zhang, Jie Wang, Jieping Ye, Feng Wu
Abstract
Graph convolutional networks (GCNs)-which are effective in modeling graph structures-have been increasingly popular in knowledge graph completion (KGC). GCN-based KGC models first use GCNs to generate expressive entity representations and then use knowledge graph embedding (KGE) models to capture the interactions among entities and relations. However, many GCN-based KGC models fail to outperform state-of-the-art KGE models though introducing additional computational complexity. This phenomenon motivates us to explore the real effect of GCNs in KGC. Therefore, in this paper, we build upon representative GCN-based KGC models and introduce variants to find which factor of GCNs is critical in KGC. Surprisingly, we observe from experiments that the graph structure modeling in GCNs does not have a significant impact on the performance of KGC models, which is in contrast to the common belief. Instead, the transformations for entity representations are responsible for the performance improvements. Based on the observation, we propose a simple yet effective framework named LTE-KGE, which equips existing KGE models with linearly transformed entity embeddings. Experiments demonstrate that LTE-KGE models lead to similar performance improvements with GCN-based KGC methods, while being more computationally efficient. These results suggest that existing GCNs are unnecessary for KGC, and novel GCN-based KGC models should count on more ablation studies to validate their effectiveness. The code of all the experiments is available on GitHub at https://github.com/MIRALab-USTC/GCN4KGC . CCS CONCEPTS • Computing methodologies → Reasoning about belief and knowledge.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2ee83a99-2308-4e33-92bc-69b6a395ec6fCited by top-tier papers12
- Knowledge Graph Completion with Counterfactual AugmentationHeng Chang, Jie Cai, Jia LiWWW 2023 · 36 citations
- Mixed Geometry Message and Trainable Convolutional Attention Network for Knowledge Graph CompletionBin Shang, Yinliang Zhao, Jun Liu, Di WangAAAI 2024 · 18 citations
- Path-based Explanation for Knowledge Graph CompletionHeng Chang, Jiangnan Ye, Alejo Lopez-Avila, Jinhua Du et al.KDD 2024 · 14 citations
- Value at Adversarial Risk: A Graph Defense Strategy against Cost-Aware AttacksJunlong Liao, Wenda Fu, Cong Wang, Zhongyu Wei et al.AAAI 2024 · 5 citations
- Exploiting Relation-aware Attribute Representation Learning in Knowledge Graph Embedding for Numerical ReasoningGayeong Kim, Sookyung Kim, Ko Keun Kim, Suchan Park et al.KDD 2023 · 4 citations
Builds on10
- Composition-based Multi-Relational Graph Convolutional NetworksShikhar Vashishth, Soumya Sanyal, Vikram Nitin, Partha P. TalukdarICLR 2020 · 1,105 citations
- K-BERT: Enabling Language Representation with Knowledge GraphWeijie Liu, Peng Zhou, Zhe Zhao, Zhiruo Wang et al.AAAI 2020 · 898 citations
- Rethinking the Value of Labels for Improving Class-Imbalanced LearningYuzhe Yang, Zhi XuNeurIPS 2020 · 512 citations
- InteractE: Improving Convolution-Based Knowledge Graph Embeddings by Increasing Feature InteractionsShikhar Vashishth, Soumya Sanyal, Vikram Nitin, Nilesh Agrawal et al.AAAI 2020 · 393 citations
- You CAN Teach an Old Dog New Tricks! On Training Knowledge Graph EmbeddingsDaniel Ruffinelli, Samuel Broscheit, Rainer GemullaICLR 2020 · 238 citations
Related papers
- Knowledge Embedding Based Graph Convolutional NetworkDonghan Yu, Yiming Yang, Ruohong Zhang, Yuexin WuWWW 2021 · 132 citations
- ExpressivE: A Spatio-Functional Embedding For Knowledge Graph CompletionAleksandar Pavlovic, Emanuel SallingerICLR 2023 · 12 citations
- Double-Branch Multi-Attention based Graph Neural Network for Knowledge Graph CompletionHongcai Xu, Junpeng Bao, Wenbo LiuACL 2023 · 17 citations
- How Does Knowledge Graph Embedding Extrapolate to Unseen Data: A Semantic Evidence ViewRen Li, Yanan Cao, Qiannan Zhu, Guanqun Bi et al.AAAI 2022 · 103 citations
- INDIGO: GNN-Based Inductive Knowledge Graph Completion Using Pair-Wise EncodingShuwen Liu, Bernardo Cuenca Grau, Ian Horrocks, Egor V. KostylevNeurIPS 2021 · 128 citations
