Dual-Kernel Graph Community Contrastive Learning
Xiang Chen, Kun Yue, Wenjie Liu, Zhenyu Zhang, Liang Duan
摘要
Graph Contrastive Learning (GCL) has emerged as a powerful paradigm for training Graph Neural Networks (GNNs) in the absence of task-specific labels. However, its scalability on large-scale graphs is hindered by the intensive message passing mechanism of GNN and the quadratic computational complexity of contrastive loss over positive and negative node pairs. To address these issues, we propose an efficient GCL framework that transforms the input graph into a compact network of interconnected node sets while preserving structural information across communities. We firstly introduce a kernelized graph community contrastive loss with linear complexity, enabling effective information transfer among node sets to capture hierarchical structural information of the graph. We then incorporate a knowledge distillation technique into the decoupled GNN architecture to accelerate inference while maintaining strong generalization performance. Extensive experiments on sixteen real-world datasets of varying scales demonstrate that our method outperforms state-of-the-art GCL baselines in both effectiveness and scalability.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper30
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong 等NeurIPS 2020 · 被引用 3,935 次
- Transformers are RNNs: Fast Autoregressive Transformers with Linear AttentionAngelos Katharopoulos, Apoorv Vyas, Nikolaos Pappas, François FleuretICML 2020 · 被引用 2,665 次
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei 等ICLR 2020 · 被引用 1,445 次
- Graph Contrastive Learning with Adaptive AugmentationYanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu 等WWW 2021 · 被引用 1,415 次
- Large-Scale Representation Learning on Graphs via BootstrappingShantanu Thakoor, Corentin Tallec, Mohammad Gheshlaghi Azar, Mehdi Azabou 等ICLR 2022 · 被引用 311 次
相关 Paper
- Hierarchical Topology Isomorphism Expertise Embedded Graph Contrastive LearningJiangmeng Li, Yifan Jin, Hang Gao, Wenwen Qiang 等AAAI 2024 · 被引用 10 次
- StructComp: Substituting propagation with Structural Compression in Training Graph Contrastive LearningShengzhong Zhang, Wenjie Yang, Xinyuan Cao, Hongwei Zhang 等ICLR 2024 · 被引用 6 次
- E2GCL: Efficient and Expressive Contrastive Learning on Graph Neural NetworksHaoyang Li, Shimin Di, Lei Chen, Xiaofang ZhouICDE 2024 · 被引用 6 次
- CL-GCL: Comprehensive and Lightweight Graph Contrastive LearningJianqing Liang, Xinkai Wei, Zhiqiang LiICML 2026
- Efficient Contrastive Learning for Fast and Accurate Inference on GraphsTeng Xiao, Huaisheng Zhu, Zhiwei Zhang, Zhimeng Guo 等ICML 2024 · 被引用 15 次
