Dual-Kernel Graph Community Contrastive Learning
Xiang Chen, Kun Yue, Wenjie Liu, Zhenyu Zhang, Liang Duan
Abstract
Graph Contrastive Learning (GCL) has emerged as a powerful paradigm for training Graph Neural Networks (GNNs) in the absence of task-specific labels. However, its scalability on large-scale graphs is hindered by the intensive message passing mechanism of GNN and the quadratic computational complexity of contrastive loss over positive and negative node pairs. To address these issues, we propose an efficient GCL framework that transforms the input graph into a compact network of interconnected node sets while preserving structural information across communities. We firstly introduce a kernelized graph community contrastive loss with linear complexity, enabling effective information transfer among node sets to capture hierarchical structural information of the graph. We then incorporate a knowledge distillation technique into the decoupled GNN architecture to accelerate inference while maintaining strong generalization performance. Extensive experiments on sixteen real-world datasets of varying scales demonstrate that our method outperforms state-of-the-art GCL baselines in both effectiveness and scalability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on30
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Transformers are RNNs: Fast Autoregressive Transformers with Linear AttentionAngelos Katharopoulos, Apoorv Vyas, Nikolaos Pappas, François FleuretICML 2020 · 2,665 citations
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei et al.ICLR 2020 · 1,445 citations
- Graph Contrastive Learning with Adaptive AugmentationYanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu et al.WWW 2021 · 1,415 citations
- Large-Scale Representation Learning on Graphs via BootstrappingShantanu Thakoor, Corentin Tallec, Mohammad Gheshlaghi Azar, Mehdi Azabou et al.ICLR 2022 · 311 citations
Related papers
- Hierarchical Topology Isomorphism Expertise Embedded Graph Contrastive LearningJiangmeng Li, Yifan Jin, Hang Gao, Wenwen Qiang et al.AAAI 2024 · 10 citations
- StructComp: Substituting propagation with Structural Compression in Training Graph Contrastive LearningShengzhong Zhang, Wenjie Yang, Xinyuan Cao, Hongwei Zhang et al.ICLR 2024 · 6 citations
- E2GCL: Efficient and Expressive Contrastive Learning on Graph Neural NetworksHaoyang Li, Shimin Di, Lei Chen, Xiaofang ZhouICDE 2024 · 6 citations
- CL-GCL: Comprehensive and Lightweight Graph Contrastive LearningJianqing Liang, Xinkai Wei, Zhiqiang LiICML 2026
- Efficient Contrastive Learning for Fast and Accurate Inference on GraphsTeng Xiao, Huaisheng Zhu, Zhiwei Zhang, Zhimeng Guo et al.ICML 2024 · 15 citations
