SLAPS: Self-Supervision Improves Structure Learning for Graph Neural Networks
Bahare Fatemi, Layla El Asri, Seyed Mehran Kazemi
摘要
Graph neural networks (GNNs) work well when the graph structure is provided. However, this structure may not always be available in real-world applications. One solution to this problem is to infer a task-specific latent structure and then apply a GNN to the inferred graph. Unfortunately, the space of possible graph structures grows super-exponentially with the number of nodes and so the task-specific supervision may be insufficient for learning both the structure and the GNN parameters. In this work, we propose the Simultaneous Learning of Adjacency and GNN Parameters with Self-supervision, or SLAPS, a method that provides more supervision for inferring a graph structure through self-supervision. A comprehensive experimental study demonstrates that SLAPS scales to large graphs with hundreds of thousands of nodes and outperforms several models that have been proposed to learn a task-specific graph structure on established benchmarks.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper54
- Towards Unsupervised Deep Graph Structure LearningYixin Liu, Yu Zheng, Daokun Zhang, Hongxu Chen 等WWW 2022 · 被引用 257 次
- Edge Prompt Tuning for Graph Neural NetworksXingbo Fu, Yinhan He, Jundong LiICLR 2025 · 被引用 140 次
- Beyond Smoothing: Unsupervised Graph Representation Learning with Edge Heterophily DiscriminatingYixin Liu, Yizhen Zheng, Daokun Zhang, Vincent C. S. Lee 等AAAI 2023 · 被引用 116 次
- Reliable Representations Make A Stronger Defender: Unsupervised Structure Refinement for Robust GNNKuan Li, Yang Liu, Xiang Ao, Jianfeng Chi 等KDD 2022 · 被引用 63 次
- Knowledge Distillation Improves Graph Structure Augmentation for Graph Neural NetworksLirong Wu, Haitao Lin, Yufei Huang, Stan Z. LiNeurIPS 2022 · 被引用 60 次
它引用的顶会 Paper14
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong 等NeurIPS 2020 · 被引用 3,935 次
- Reformer: The Efficient TransformerNikita Kitaev, Lukasz Kaiser, Anselm LevskayaICLR 2020 · 被引用 2,878 次
- Strategies for Pre-training Graph Neural NetworksWeihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik 等ICLR 2020 · 被引用 1,744 次
- DeepGCNs: Can GCNs Go As Deep As CNNs?Guohao Li, Matthias Müller, Ali K. Thabet, Bernard GhanemICCV 2019 · 被引用 1,586 次
- Beyond Homophily in Graph Neural Networks: Current Limitations and Effective DesignsJiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann 等NeurIPS 2020 · 被引用 1,490 次
相关 Paper
- GPT-GNN: Generative Pre-Training of Graph Neural NetworksZiniu Hu, Yuxiao Dong, Kuansan Wang, Kai-Wei Chang 等KDD 2020 · 被引用 438 次
- Self-Supervised Representation Learning via Latent Graph PredictionYaochen Xie, Zhao Xu, Shuiwang JiICML 2022 · 被引用 43 次
- From Local Structures to Size Generalization in Graph Neural NetworksGilad Yehudai, Ethan Fetaya, Eli A. Meirom, Gal Chechik 等ICML 2021 · 被引用 167 次
- Pointer Graph NetworksPetar Velickovic, Lars Buesing, Matthew C. Overlan, Razvan Pascanu 等NeurIPS 2020 · 被引用 78 次
- Rethinking Graph Regularization for Graph Neural NetworksHan Yang, Kaili Ma, James ChengAAAI 2021 · 被引用 86 次
