Simple Unsupervised Graph Representation Learning
Yujie Mo, Liang Peng, Jie Xu, Xiaoshuang Shi, Xiaofeng Zhu
Abstract
In this paper, we propose a simple unsupervised graph representation learning method to conduct effective and efficient contrastive learning. Specifically, the proposed multiplet loss explores the complementary information between the structural information and neighbor information to enlarge the interclass variation, as well as adds an upper bound loss to achieve the finite distance between positive embeddings and anchor embeddings for reducing the intra-class variation. As a result, both enlarging inter-class variation and reducing intra-class variation result in a small generalization error, thereby obtaining an effective model. Furthermore, our method removes widely used data augmentation and discriminator from previous graph contrastive learning methods, meanwhile available to output low-dimensional embeddings, leading to an efficient model. Experimental results on various real-world datasets demonstrate the effectiveness and efficiency of our method, compared to state-of-the-art methods. The source codes are released at https://github.com/YujieMo/SUGRL .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f425fa1c-0483-4cfd-a274-428752a8e854Cited by top-tier papers42
- Spectral Feature Augmentation for Graph Contrastive Learning and BeyondYifei Zhang, Hao Zhu, Zixing Song, Piotr Koniusz et al.AAAI 2023 · 131 citations
- What's Behind the Mask: Understanding Masked Graph Modeling for Graph AutoencodersJintang Li, Ruofan Wu, Wangbin Sun, Liang Chen et al.KDD 2023 · 89 citations
- Dink-Net: Neural Clustering on Large GraphsYue Liu, Ke Liang, Jun Xia, Sihang Zhou et al.ICML 2023 · 78 citations
- Decoupled Self-supervised Learning for GraphsTeng Xiao, Zhengyu Chen, Zhimeng Guo, Zeyang Zhuang et al.NeurIPS 2022 · 75 citations
- Virtual Node Tuning for Few-shot Node ClassificationZhen Tan, Ruocheng Guo, Kaize Ding, Huan LiuKDD 2023 · 61 citations
Builds on15
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 1,663 citations
- Graph Contrastive Learning with Adaptive AugmentationYanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu et al.WWW 2021 · 1,415 citations
Related papers
- Simple Self-supervised Multiplex Graph Representation LearningYujie Mo, Yuhuan Chen, Liang Peng, Xiaoshuang Shi et al.ACM MM 2022 · 9 citations
- Adversarial Graph Contrastive Learning with Information RegularizationShengyu Feng, Baoyu Jing, Yada Zhu, Hanghang TongWWW 2022 · 76 citations
- Graph Self-supervised Learning with Augmentation-aware Contrastive LearningDong Chen, Xiang Zhao, Wei Wang, Zhen Tan et al.WWW 2023 · 17 citations
- Neighbor Contrastive Learning on Learnable Graph AugmentationXiao Shen, Dewang Sun, Shirui Pan, Xi Zhou et al.AAAI 2023 · 144 citations
- CL-GCL: Comprehensive and Lightweight Graph Contrastive LearningJianqing Liang, Xinkai Wei, Zhiqiang LiICML 2026
