Graph Contrastive Learning Reimagined: Exploring Universality
Jiaming Zhuo, Can Cui, Kun Fu, Bingxin Niu, Dongxiao He, Chuan Wang, Yuanfang Guo, Zhen Wang, Xiaochun Cao, Liang Yang
Abstract
Real-world graphs exhibit diverse structures, including homophilic and heterophilic patterns, necessitating the development of a universal Graph Contrastive Learning (GCL) framework. Nonetheless, the existing GCLs, especially those with a local focus, lack universality due to the mismatch between the input graph structure and the homophily assumption for two primary components of GCLs. Firstly, the encoder, commonly Graph Convolution Network (GCN), operates as a low-pass filter, which assumes the input graph to be homophilic. This makes it challenging to aggregate features from neighbor nodes of the same class on heterophilic graphs. Secondly, the local positive sampling regards neighbor nodes as positive samples, which is inspired by the homophily assumption. This results in feature similarity amplification for the samples from the different classes (i.e., FALSE positive samples). Therefore, it is crucial to feed the encoder and positive sampling of GCLs with homophilic graph structures. This paper presents a novel GCL framework, named gRaph cOntraStive Exploring uNiversality (ROSEN), designed to achieve this objective. Specifically, ROSEN equips a local graph structure inference module, utilizing the Block Diagonal Property (BDP) of the affinity matrix extracted from node ego networks. This module can generate the homophilic graph structure by selectively removing disassortative edges. Extensive evaluations validate the effectiveness and universality of ROSEN across node classification and node clustering tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 69cc79a6-9f6e-476b-9024-9a7811681b59Cited by top-tier papers15
- FUG: Feature-Universal Graph Contrastive Pre-training for Graphs with Diverse Node FeaturesJitao Zhao, Di Jin, Meng Ge, Lianze Shan et al.NeurIPS 2024 · 20 citations
- Unified Graph Augmentations for Generalized Contrastive Learning on GraphsJiaming Zhuo, Yintong Lu, Hui Ning, Kun Fu et al.NeurIPS 2024 · 19 citations
- One Prompt Fits All: Universal Graph Adaptation for Pretrained ModelsYongqi Huang, Jitao Zhao, Dongxiao He, Xiaobao Wang et al.NeurIPS 2025 · 15 citations
- Improving Graph Contrastive Learning via Adaptive Positive SamplingJiaming Zhuo, Feiyang Qin, Can Cui, Kun Fu et al.CVPR 2024 · 7 citations
- Str-GCL: Structural Commonsense Driven Graph Contrastive LearningDongxiao He, Yongqi Huang, Jitao Zhao, Xiaobao Wang et al.WWW 2025 · 6 citations
Builds on12
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 1,663 citations
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei et al.ICLR 2020 · 1,445 citations
- Graph Contrastive Learning with Adaptive AugmentationYanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu et al.WWW 2021 · 1,415 citations
Related papers
- Graph Contrastive Learning via Interventional View GenerationZengyi Wo, Minglai Shao, Wenjun Wang, Xuan Guo et al.WWW 2024 · 13 citations
- PolyGCL: GRAPH CONTRASTIVE LEARNING via Learnable Spectral Polynomial FiltersJingyu Chen, Runlin Lei, Zhewei WeiICLR 2024 · 49 citations
- Attribute and Structure Preserving Graph Contrastive LearningJialu Chen, Gang KouAAAI 2023 · 62 citations
- Beyond Homophily: Graph Contrastive Learning with Macro-Micro Message PassingYiyuan Chen, Donghai Guan, Weiwei Yuan, Tianzi ZangAAAI 2025 · 5 citations
- Neighbor Contrastive Learning on Learnable Graph AugmentationXiao Shen, Dewang Sun, Shirui Pan, Xi Zhou et al.AAAI 2023 · 144 citations
