ACL Findings2023
Contrastive Learning with Generated Representations for Inductive Knowledge Graph Embedding
Qian Li, Shafiq Joty, Daling Wang, Shi Feng, Yifei Zhang, Chengwei Qin
Abstract
With the evolution of Knowledge Graphs (KGs), new entities emerge which are not seen before. Representation learning of KGs in such an inductive setting aims to capture and transfer the structural patterns from existing entities to new entities. However, the performance of existing methods in inductive KGs are limited by sparsity and implicit transfer. In this paper, we propose VMCL, a Contrastive Learning (CL) framework with graph guided Variational autoencoder on Meta-KGs in the inductive setting. We first propose representation generation to capture the encoded and generated representations of entities, where the generated variations can augment the representation space with complementary features. Then, we design two CL objectives that work across entities and meta-KGs to simulate the transfer mode. With extensive experiments we demonstrate that our proposed VMCL can significantly outperform previous state-of-the-art baselines.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
2 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Contrastive Multi-View Representation Learning on Graphs cites InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization
- Graph Contrastive Learning with Adaptive Augmentation cites Contrastive Multi-View Representation Learning on Graphs
Cited by top-tier papers2
- Beyond Output Matching: Bidirectional Alignment for Enhanced In-Context LearningChengwei Qin, Wenhan Xia, Fangkai Jiao, Chen Chen et al.ACL 2025 · 7 citations
- Enhancing Contrastive Learning Inspired by the Philosophy of "The Blind Men and the Elephant"Yudong Zhang, Ruobing Xie, Jiansheng Chen, Xingwu Sun et al.AAAI 2025 · 3 citations
Builds on11
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 citations
- Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 1,663 citations
- Graph Contrastive Learning with Adaptive AugmentationYanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu et al.WWW 2021 · 1,415 citations
- InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information MaximizationFan-Yun Sun, Jordan Hoffmann, Vikas Verma, Jian TangICLR 2020 · 1,010 citations
- Inductive Relation Prediction by Subgraph ReasoningKomal K. Teru, Etienne G. Denis, William L. HamiltonICML 2020 · 493 citations
Related papers
- Contrast then Memorize: Semantic Neighbor Retrieval-Enhanced Inductive Multimodal Knowledge Graph CompletionYu Zhao, Ying Zhang, Baohang Zhou, Xinying Qian et al.SIGIR 2024 · 15 citations
- AutoGCL: Automated Graph Contrastive Learning via Learnable View GeneratorsYihang Yin, Qingzhong Wang, Siyu Huang, Haoyi Xiong et al.AAAI 2022 · 203 citations
- KRACL: Contrastive Learning with Graph Context Modeling for Sparse Knowledge Graph CompletionZhaoxuan Tan, Zilong Chen, Shangbin Feng, Qingyue Zhang et al.WWW 2023 · 50 citations
- Self-derived Knowledge Graph Contrastive Learning for RecommendationLei Shi, Jiapeng Yang, Pengtao Lv, Lu Yuan et al.ACM MM 2024 · 18 citations
- Meta-Knowledge Transfer for Inductive Knowledge Graph EmbeddingMingyang Chen, Wen Zhang, Yushan Zhu, Hongting Zhou et al.SIGIR 2022 · 69 citations
