Randomized Schur Complement Views for Graph Contrastive Learning
Vignesh Kothapalli
Abstract
We introduce a randomized topological augmentor based on Schur complements for Graph Contrastive Learning (GCL). Given a graph laplacian matrix, the technique generates unbiased approximations of its Schur complements and treats the corresponding graphs as augmented views. We discuss the benefits of our approach, provide theoretical justifications and present connections with graph diffusion. Unlike previous efforts, we study the empirical effectiveness of the augmentor in a controlled fashion by varying the design choices for subsequent GCL phases, such as encoding and contrasting. Extensive experiments on node and graph classification benchmarks demonstrate that our technique consistently outperforms pre-defined and adaptive augmentation approaches to achieve state-of-the-art results.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 09bf8f8b-5877-42fa-9045-bfe28b60c773Cited by top-tier papers1
Ask how each one uses itBuilds on19
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
- Barlow Twins: Self-Supervised Learning via Redundancy ReductionJure Zbontar, Li Jing, Ishan Misra, Yann LeCun et al.ICML 2021 · 2,942 citations
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik et al.ICLR 2020 · 1,744 citations
Related papers
- MA-GCL: Model Augmentation Tricks for Graph Contrastive LearningXumeng Gong, Cheng Yang, Chuan ShiAAAI 2023 · 68 citations
- Graph Contrastive Learning with Adaptive AugmentationYanqiao Zhu, Yichen Xu, Feng Yu, Qiang Liu et al.WWW 2021 · 1,415 citations
- GraphLearner: Graph Node Clustering with Fully Learnable AugmentationXihong Yang, Erxue Min, Ke Liang, Yue Liu et al.ACM MM 2024 · 14 citations
- Spectral Augmentation for Self-Supervised Learning on GraphsLu Lin, Jinghui Chen, Hongning WangICLR 2023 · 16 citations
- SGCL: Semantic-aware Graph Contrastive Learning with Lipschitz Graph AugmentationJinhao Cui, Heyan Chai, Xu Yang, Ye Ding et al.ICDE 2024 · 1 citation
