Contrastive Multi-View Representation Learning on Graphs
Kaveh Hassani, Amir Hosein Khas Ahmadi
Abstract
We introduce a self-supervised approach for learning node and graph level representations by contrasting structural views of graphs. We show that unlike visual representation learning, increasing the number of views to more than two or contrasting multi-scale encodings do not improve performance, and the best performance is achieved by contrasting encodings from first-order neighbors and a graph diffusion. We achieve new state-of-the-art results in self-supervised learning on 8 out of 8 node and graph classification benchmarks under the linear evaluation protocol. For example, on Cora (node) and Reddit-Binary (graph) classification benchmarks, we achieve 86.8% and 84.5% accuracy, which are 5.5% and 2.4% relative improvements over previous state-of-the-art. When compared to supervised baselines, our approach outperforms them in 4 out of 8 benchmarks. Source code is released at: this https URL
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 295df852-1b12-44c2-9211-4be2bc829b41Cited by top-tier papers320
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Self-supervised Graph Learning for RecommendationJiancan Wu, Xiang Wang, Fuli Feng, Xiangnan He et al.SIGIR 2021 · 1,476 citations
- Graph Contrastive Learning with Adaptive AugmentationYanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu et al.WWW 2021 · 1,415 citations
- Contrastive Learning with Hard Negative SamplesJoshua David Robinson, Ching-Yao Chuang, Suvrit Sra, Stefanie JegelkaICLR 2021 · 999 citations
- Self-Supervised Hypergraph Convolutional Networks for Session-based RecommendationXin Xia, Hongzhi Yin, Junliang Yu, Qinyong Wang et al.AAAI 2021 · 615 citations
Builds on6
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information MaximizationFan-Yun Sun, Jordan Hoffmann, Vikas Verma, Jian TangICLR 2020 · 1,010 citations
- On Mutual Information Maximization for Representation LearningMichael Tschannen, Josip Djolonga, Paul K. Rubenstein, Sylvain Gelly et al.ICLR 2020 · 559 citations
- Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation LearningJiwoong Park, Minsik Lee, Hyung Jin Chang, Kyuewang Lee et al.ICCV 2019 · 280 citations
- Unsupervised Multi-Task Feature Learning on Point CloudsKaveh Hassani, Mike HaleyICCV 2019 · 205 citations
Related papers
- Augmentation-Free Self-Supervised Learning on GraphsNamkyeong Lee, Junseok Lee, Chanyoung ParkAAAI 2022 · 288 citations
- Self-supervised Consensus Representation Learning for Attributed GraphChangshu Liu, Liangjian Wen, Zhao Kang, Guangchun Luo et al.ACM MM 2021 · 49 citations
- Discrepancy-Aware Graph Mask Auto-EncoderZiyu Zheng, Yaming Yang, Ziyu Guan, Wei Zhao et al.KDD 2025
- Self-Contrastive Graph Diffusion NetworkYixuan Ma, Kun ZhanACM MM 2023 · 15 citations
- Omni-Granular Ego-Semantic Propagation for Self-Supervised Graph Representation LearningLing Yang, Shenda HongICML 2022 · 12 citations
