SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networks
Bahare Fatemi, Layla El Asri, Seyed Mehran Kazemi
Abstract
Graph neural networks (GNNs) work well when the graph structure is provided. However, this structure may not always be available in real-world applications. One solution to this problem is to infer a task-specific latent structure and then apply a GNN to the inferred graph. Unfortunately, the space of possible graph structures grows super-exponentially with the number of nodes and so the task-specific supervision may be insufficient for learning both the structure and the GNN parameters. In this work, we propose the Simultaneous Learning of Adjacency and GNN Parameters with Self-supervision, or SLAPS, a method that provides more supervision for inferring a graph structure through self-supervision. A comprehensive experimental study demonstrates that SLAPS scales to large graphs with hundreds of thousands of nodes and outperforms several models that have been proposed to learn a task-specific graph structure on established benchmarks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2275d1c9-593a-4183-be4e-a8f22f25c356Cited by top-tier papers54
- Towards Unsupervised Deep Graph Structure LearningYixin Liu, Yu Zheng, Daokun Zhang, Hongxu Chen et al.WWW 2022 · 257 citations
- Edge Prompt Tuning for Graph Neural NetworksXingbo Fu, Yinhan He, Jundong LiICLR 2025 · 140 citations
- Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily DiscriminatingYixin Liu, Yizhen Zheng, Daokun Zhang, Vincent C. S. Lee et al.AAAI 2023 · 116 citations
- Reliable Representations Make A Stronger Defender: Unsupervised Structure Refinement for Robust GNNKuan Li, Yang Liu, Xiang Ao, Jianfeng Chi et al.KDD 2022 · 63 citations
- Knowledge Distillation Improves Graph Structure Augmentation for Graph Neural NetworksLirong Wu, Haitao Lin, Yufei Huang, Stan Z. LiNeurIPS 2022 · 60 citations
Builds on14
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Reformer: The Efficient TransformerNikita Kitaev, Lukasz Kaiser, Anselm LevskayaICLR 2020 · 2,878 citations
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik et al.ICLR 2020 · 1,744 citations
- DeepGCNs: Can GCNs Go As Deep As CNNs?Guohao Li, Matthias Müller, Ali K. Thabet, Bernard GhanemICCV 2019 · 1,586 citations
- Beyond Homophily in Graph Neural Networks: Current Limitations and Effective DesignsJiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann et al.NeurIPS 2020 · 1,490 citations
Related papers
- GPT-GNN: Generative Pre-Training of Graph Neural NetworksZiniu Hu, Yuxiao Dong, Kuansan Wang, Kai-Wei Chang et al.KDD 2020 · 438 citations
- Self-Supervised Representation Learning via Latent Graph PredictionYaochen Xie, Zhao Xu, Shuiwang JiICML 2022 · 43 citations
- From Local Structures to Size Generalization in Graph Neural NetworksGilad Yehudai, Ethan Fetaya, Eli A. Meirom, Gal Chechik et al.ICML 2021 · 167 citations
- Pointer Graph NetworksPetar Velickovic, Lars Buesing, Matthew C. Overlan, Razvan Pascanu et al.NeurIPS 2020 · 78 citations
- Rethinking Graph Regularization for Graph Neural NetworksHan Yang, Kaili Ma, James ChengAAAI 2021 · 86 citations
