Simple and Asymmetric Graph Contrastive Learning without Augmentations
Teng Xiao, Huaisheng Zhu, Zhengyu Chen, Suhang Wang
Abstract
Graph Contrastive Learning (GCL) has shown superior performance in representation learning in graph-structured data. Despite their success, most existing GCL methods rely on prefabricated graph augmentation and homophily assumptions. Thus, they fail to generalize well to heterophilic graphs where connected nodes may have different class labels and dissimilar features. In this paper, we study the problem of conducting contrastive learning on homophilic and heterophilic graphs. We find that we can achieve promising performance simply by considering an asymmetric view of the neighboring nodes. The resulting simple algorithm, Asymmetric Contrastive Learning for Graphs (GraphACL), is easy to implement and does not rely on graph augmentations and homophily assumptions. We provide theoretical and empirical evidence that GraphACL can capture one-hop local neighborhood information and two-hop monophily similarity, which are both important for modeling heterophilic graphs. Experimental results show that the simple GraphACL significantly outperforms state-of-the-art graph contrastive learning and self-supervised learning methods on homophilic and heterophilic graphs. The code of GraphACL is available at https://github.com/tengxiao1/GraphACL .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a2504e6f-e769-47cb-8dee-6929a881820dCited by top-tier papers23
- S3GCL: Spectral, Swift, Spatial Graph Contrastive LearningGuancheng Wan, Yijun Tian, Wenke Huang, Nitesh V. Chawla et al.ICML 2024 · 26 citations
- FUG: Feature-Universal Graph Contrastive Pre-training for Graphs with Diverse Node FeaturesJitao Zhao, Di Jin, Meng Ge, Lianze Shan et al.NeurIPS 2024 · 20 citations
- GRAVER: Generative Graph Vocabularies for Robust Graph Foundation Models Fine-tuningHaonan Yuan, Qingyun Sun, Junhua Shi, Xingcheng Fu et al.NeurIPS 2025 · 17 citations
- Efficient Contrastive Learning for Fast and Accurate Inference on GraphsTeng Xiao, Huaisheng Zhu, Zhiwei Zhang, Zhimeng Guo et al.ICML 2024 · 15 citations
- LOHA: Direct Graph Spectral Contrastive Learning Between Low-Pass and High-Pass ViewsZiyun Zou, Yinghui Jiang, Lian Shen, Juan Liu et al.AAAI 2025 · 8 citations
Builds on31
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Beyond Homophily in Graph Neural Networks: Current Limitations and Effective DesignsJiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann et al.NeurIPS 2020 · 1,490 citations
Related papers
- Neighbor Contrastive Learning on Learnable Graph AugmentationXiao Shen, Dewang Sun, Shirui Pan, Xi Zhou et al.AAAI 2023 · 144 citations
- Graph Contrastive Learning via Interventional View GenerationZengyi Wo, Minglai Shao, Wenjun Wang, Xuan Guo et al.WWW 2024 · 13 citations
- HomoGCL: Rethinking Homophily in Graph Contrastive LearningWen-Zhi Li, Chang-Dong Wang, Hui Xiong, Jian-Huang LaiKDD 2023 · 31 citations
- PolyGCL: GRAPH CONTRASTIVE LEARNING via Learnable Spectral Polynomial FiltersJingyu Chen, Runlin Lei, Zhewei WeiICLR 2024 · 49 citations
- Attribute and Structure Preserving Graph Contrastive LearningJialu Chen, Gang KouAAAI 2023 · 62 citations
