Graph Adversarial Self-Supervised Learning
Longqi Yang, Liangliang Zhang, Wenjing Yang
Abstract
This paper studies a long-standing problem of learning the representations of a whole graph without human supervision. The recent self-supervised learning methods train models to be invariant to the transformations (views) of the inputs. However, designing these views requires the experience of human experts. Inspired by adversarial training, we propose an adversarial self-supervised learning (GASSL) framework for learning unsupervised representations of graph data without any handcrafted views. GASSL automatically generates challenging views by adding perturbations to the input and are adversarially trained with respect to the encoder. Our method optimizes the min-max problem and utilizes a gradient accumulation strategy to accelerate the training process. Experimental on ten graph classification datasets show that the proposed approach is superior to state-of-the-art self-supervised learning baselines, which are competitive with supervised models.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 3e0f4ad2-c02d-4b8d-84c7-b892a03fcc80Cited by top-tier papers16
- Revisiting Graph Contrastive Learning from the Perspective of Graph SpectrumNian Liu, Xiao Wang, Deyu Bo, Chuan Shi et al.NeurIPS 2022 · 102 citations
- MA-GCL: Model Augmentation Tricks for Graph Contrastive LearningXumeng Gong, Cheng Yang, Chuan ShiAAAI 2023 · 68 citations
- Graph Self-supervised Learning with Accurate Discrepancy LearningDongki Kim, Jinheon Baek, Sung Ju HwangNeurIPS 2022 · 46 citations
- Graph Contrastive Learning with Generative Adversarial NetworkCheng Wu, Chaokun Wang, Jingcao Xu, Ziyang Liu et al.KDD 2023 · 33 citations
- Graph Mixup on Approximate Gromov-Wasserstein GeodesicsZhichen Zeng, Ruizhong Qiu, Zhe Xu, Zhining Liu et al.ICML 2024 · 30 citations
Builds on25
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal et al.NeurIPS 2020 · 5,249 citations
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Graph Contrastive Learning with AugmentationsYuning You, Tianlong Chen, Yongduo Sui, Ting Chen et al.NeurIPS 2020 · 3,042 citations
Related papers
- Contrastive Self-supervised Learning for Graph ClassificationJiaqi Zeng, Pengtao XieAAAI 2021 · 176 citations
- Adversarial Contrastive Graph Augmentation with Counterfactual RegularizationTao Long, Lei Zhang, Liang Zhang, Laizhong CuiAAAI 2025 · 5 citations
- Spectral Augmentation for Self-Supervised Learning on GraphsLu Lin, Jinghui Chen, Hongning WangICLR 2023 · 16 citations
- Analyzing Data-Centric Properties for Graph Contrastive LearningPuja Trivedi, Ekdeep Singh Lubana, Mark Heimann, Danai Koutra et al.NeurIPS 2022 · 13 citations
- Graph Self-supervised Learning with Augmentation-aware Contrastive LearningDong Chen, Xiang Zhao, Wei Wang, Zhen Tan et al.WWW 2023 · 17 citations
