InteractE: Improving Convolution-Based Knowledge Graph Embeddings by Increasing Feature Interactions
Shikhar Vashishth, Soumya Sanyal, Vikram Nitin, Nilesh Agrawal, Partha P. Talukdar
Abstract
Most existing knowledge graphs suffer from incompleteness, which can be alleviated by inferring missing links based on known facts. One popular way to accomplish this is to generate low-dimensional embeddings of entities and relations, and use these to make inferences. ConvE, a recently proposed approach, applies convolutional filters on 2D reshapings of entity and relation embeddings in order to capture rich interactions between their components. However, the number of interactions that ConvE can capture is limited. In this paper, we analyze how increasing the number of these interactions affects link prediction performance, and utilize our observations to propose InteractE. InteractE is based on three key ideas -- feature permutation, a novel feature reshaping, and circular convolution. Through extensive experiments, we find that InteractE outperforms state-of-the-art convolutional link prediction baselines on FB15k-237. Further, InteractE achieves an MRR score that is 9%, 7.5%, and 23% better than ConvE on the FB15k-237, WN18RR and YAGO3-10 datasets respectively. The results validate our central hypothesis -- that increasing feature interaction is beneficial to link prediction performance. We make the source code of InteractE available to encourage reproducible research.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d6efa459-772b-46a0-977d-dd4c45a0f97cCited by top-tier papers18
- TimeTraveler: Reinforcement Learning for Temporal Knowledge Graph ForecastingHaohai Sun, Jialun Zhong, Yunpu Ma, Zhen Han et al.EMNLP 2021 · 164 citations
- IMF: Interactive Multimodal Fusion Model for Link PredictionXinhang Li, Xiangyu Zhao, Jiaxing Xu, Yong Zhang et al.WWW 2023 · 113 citations
- How Does Knowledge Graph Embedding Extrapolate to Unseen Data: A Semantic Evidence ViewRen Li, Yanan Cao, Qiannan Zhu, Guanqun Bi et al.AAAI 2022 · 103 citations
- Rethinking Graph Convolutional Networks in Knowledge Graph CompletionZhanqiu Zhang, Jie Wang, Jieping Ye, Feng WuWWW 2022 · 83 citations
- ReInceptionE: Relation-Aware Inception Network with Joint Local-Global Structural Information for Knowledge Graph EmbeddingZhiwen Xie, Guangyou Zhou, Jin Liu, Jimmy Xiangji HuangACL 2020 · 64 citations
Related papers
- ParamE: Regarding Neural Network Parameters as Relation Embeddings for Knowledge Graph CompletionFeihu Che, Dawei Zhang, Jianhua Tao, Mingyue Niu et al.AAAI 2020 · 54 citations
- HyConvE: A Novel Embedding Model for Knowledge Hypergraph Link Prediction with Convolutional Neural NetworksChenxu Wang, Xin Wang, Zhao Li, Zirui Chen et al.WWW 2023 · 50 citations
- Multimodal Contextual Interactions of Entities: A Modality Circular Fusion Approach for Link PredictionJing Yang, Shundong Yang, Yuan Gao, Jieming Yang et al.ACM MM 2024 · 7 citations
- Contextual Parameter Generation for Knowledge Graph Link PredictionGeorge Stoica, Otilia Stretcu, Emmanouil Antonios Platanios, Tom M. Mitchell et al.AAAI 2020 · 46 citations
- Answering Complex Queries in Knowledge Graphs with Bidirectional Sequence EncodersBhushan Kotnis, Carolin Lawrence, Mathias NiepertAAAI 2021 · 48 citations
