Graph Random Neural Networks for Semi-Supervised Learning on Graphs
Wenzheng Feng, Jie Zhang, Yuxiao Dong, Yu Han, Huanbo Luan, Qian Xu, Qiang Yang, Evgeny Kharlamov, Jie Tang
摘要
We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing [7, 27, 28, 34] , non-robustness [54, 51] , and weak-generalization when labeled nodes are scarce. In this paper, we propose a simple yet effective framework-GRAPH RANDOM NEURAL NETWORKS (GRAND)-to address these issues. In GRAND, we first design a random propagation strategy to perform graph data augmentation. Then we leverage consistency regularization to optimize the prediction consistency of unlabeled nodes across different data augmentations. Extensive experiments on graph benchmark datasets suggest that GRAND significantly outperforms state-ofthe-art GNN baselines on semi-supervised node classification. Finally, we show that GRAND mitigates the issues of over-smoothing and non-robustness, exhibiting better generalization behavior than existing GNNs. The source code of GRAND is publicly available at https://github.com/Grand20/grand .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper91
- Are we really making much progress?: Revisiting, benchmarking and refining heterogeneous graph neural networksQingsong Lv, Ming Ding, Qiang Liu, Yuxiang Chen 等KDD 2021 · 被引用 249 次
- GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph LearnerZhenyu Hou, Yufei He, Yukuo Cen, Xiao Liu 等WWW 2023 · 被引用 183 次
- DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural NetworksPál András Papp, Karolis Martinkus, Lukas Faber, Roger WattenhoferNeurIPS 2021 · 被引用 182 次
- Dirichlet Energy Constrained Learning for Deep Graph Neural NetworksKaixiong Zhou, Xiao Huang, Daochen Zha, Rui Chen 等NeurIPS 2021 · 被引用 171 次
- Graph Anomaly Detection via Multi-Scale Contrastive Learning Networks with Augmented ViewJingcan Duan, Siwei Wang, Pei Zhang, En Zhu 等AAAI 2023 · 被引用 159 次
它引用的顶会 Paper5
- Unsupervised Data Augmentation for Consistency TrainingQizhe Xie, Zihang Dai, Eduard H. Hovy, Thang Luong 等NeurIPS 2020 · 被引用 2,774 次
- DropEdge: Towards Deep Graph Convolutional Networks on Node ClassificationYu Rong, Wenbing Huang, Tingyang Xu, Junzhou HuangICLR 2020 · 被引用 1,599 次
- Measuring and Relieving the Over-Smoothing Problem for Graph Neural Networks from the Topological ViewDeli Chen, Yankai Lin, Wei Li, Peng Li 等AAAI 2020 · 被引用 1,353 次
- Graph Neural Networks Exponentially Lose Expressive Power for Node ClassificationKenta Oono, Taiji SuzukiICLR 2020 · 被引用 864 次
- PairNorm: Tackling Oversmoothing in GNNsLingxiao Zhao, Leman AkogluICLR 2020 · 被引用 590 次
相关 Paper
- GRAND+: Scalable Graph Random Neural NetworksWenzheng Feng, Yuxiao Dong, Tinglin Huang, Ziqi Yin 等WWW 2022 · 被引用 56 次
- Regularizing Graph Neural Networks via Consistency-Diversity Graph AugmentationsDeyu Bo, Binbin Hu, Xiao Wang, Zhiqiang Zhang 等AAAI 2022 · 被引用 35 次
- GRAND++: Graph Neural Diffusion with A Source TermMatthew Thorpe, Tan Minh Nguyen, Hedi Xia, Thomas Strohmer 等ICLR 2022 · 被引用 108 次
- NRGNN: Learning a Label Noise Resistant Graph Neural Network on Sparsely and Noisily Labeled GraphsEnyan Dai, Charu Aggarwal, Suhang WangKDD 2021 · 被引用 80 次
- Hypergraph-enhanced Dual Semi-supervised Graph ClassificationWei Ju, Zhengyang Mao, Siyu Yi, Yifang Qin 等ICML 2024 · 被引用 39 次
