S3GC: Scalable Self-Supervised Graph Clustering
Devvrit, Aditya Sinha, Inderjit S. Dhillon, Prateek Jain
Abstract
We study the problem of clustering graphs with additional side-information of node features. The problem is extensively studied, and several existing methods exploit Graph Neural Networks to learn node representations [29]. However, most of the existing methods focus on generic representations instead of their cluster-ability or do not scale to large scale graph datasets. In this work, we propose S 3 GC which uses contrastive learning along with Graph Neural Networks and node features to learn clusterable features. We empirically demonstrate that S 3 GC is able to learn the correct cluster structure even when graph information or node features are individually not informative enough to learn correct clusters. Finally, using extensive evaluation on a variety of benchmarks, we demonstrate that S 3 GC is able to significantly outperform state-of-the-art methods in terms of clustering accuracy – with as much as 5% gain in NMI – while being scalable to graphs of size 100M.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a6b6e380-6de3-470f-89cb-9cf89307efbcCited by top-tier papers6
- Dink-Net: Neural Clustering on Large GraphsYue Liu, Ke Liang, Jun Xia, Sihang Zhou et al.ICML 2023 · 78 citations
- Graph Convolutional Kernel Machine versus Graph Convolutional NetworksZhihao Wu, Zhao Zhang, Jicong FanNeurIPS 2023 · 41 citations
- LSEnet: Lorentz Structural Entropy Neural Network for Deep Graph ClusteringLi Sun, Zhenhao Huang, Hao Peng, Yujie Wang et al.ICML 2024 · 31 citations
- Revisiting Modularity Maximization for Graph Clustering: A Contrastive Learning PerspectiveYunfei Liu, Jintang Li, Yuehe Chen, Ruofan Wu et al.KDD 2024 · 26 citations
- THESAURUS: Contrastive Graph Clustering by Swapping Fused Gromov-Wasserstein CouplingsBowen Deng, Tong Wang, Lele Fu, Sheng Huang et al.AAAI 2025 · 12 citations
Builds on18
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
- Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 1,663 citations
Related papers
- Eliciting Structural and Semantic Global Knowledge in Unsupervised Graph Contrastive LearningKaize Ding, Yancheng Wang, Yingzhen Yang, Huan LiuAAAI 2023 · 32 citations
- Cluster-Guided Contrastive Graph Clustering NetworkXihong Yang, Yue Liu, Sihang Zhou, Siwei Wang et al.AAAI 2023 · 169 citations
- Deep Contrastive Graph Learning with Clustering-Oriented GuidanceMulin Chen, Bocheng Wang, Xuelong LiAAAI 2024 · 38 citations
- Multi-view Contrastive Graph ClusteringErlin Pan, Zhao KangNeurIPS 2021 · 316 citations
- Cluster-guided Contrastive Class-imbalanced Graph ClassificationWei Ju, Zhengyang Mao, Siyu Yi, Yifang Qin et al.AAAI 2025 · 6 citations
