Graph Random Neural Networks for Semi-Supervised Learning on Graphs
Wenzheng Feng, Jie Zhang, Yuxiao Dong, Yu Han, Huanbo Luan, Qian Xu, Qiang Yang, Evgeny Kharlamov, Jie Tang
Abstract
We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing [7, 27, 28, 34] , non-robustness [54, 51] , and weak-generalization when labeled nodes are scarce. In this paper, we propose a simple yet effective framework-GRAPH RANDOM NEURAL NETWORKS (GRAND)-to address these issues. In GRAND, we first design a random propagation strategy to perform graph data augmentation. Then we leverage consistency regularization to optimize the prediction consistency of unlabeled nodes across different data augmentations. Extensive experiments on graph benchmark datasets suggest that GRAND significantly outperforms state-ofthe-art GNN baselines on semi-supervised node classification. Finally, we show that GRAND mitigates the issues of over-smoothing and non-robustness, exhibiting better generalization behavior than existing GNNs. The source code of GRAND is publicly available at https://github.com/Grand20/grand .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 12f95208-0db6-496f-b1e1-d9198ca50404Cited by top-tier papers91
- Are we really making much progress?: Revisiting, benchmarking and refining heterogeneous graph neural networksQingsong Lv, Ming Ding, Qiang Liu, Yuxiang Chen et al.KDD 2021 · 249 citations
- GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph LearnerZhenyu Hou, Yufei He, Yukuo Cen, Xiao Liu et al.WWW 2023 · 183 citations
- DropGNN: Random Dropouts Increase the Expressiveness of Graph Neural NetworksPál András Papp, Karolis Martinkus, Lukas Faber, Roger WattenhoferNeurIPS 2021 · 182 citations
- Dirichlet Energy Constrained Learning for Deep Graph Neural NetworksKaixiong Zhou, Xiao Huang, Daochen Zha, Rui Chen et al.NeurIPS 2021 · 171 citations
- Graph Anomaly Detection via Multi-Scale Contrastive Learning Networks with Augmented ViewJingcan Duan, Siwei Wang, Pei Zhang, En Zhu et al.AAAI 2023 · 159 citations
Builds on5
- Unsupervised Data Augmentation for Consistency TrainingQizhe Xie, Zihang Dai, Eduard H. Hovy, Thang Luong et al.NeurIPS 2020 · 2,774 citations
- DropEdge: Towards Deep Graph Convolutional Networks on Node ClassificationYu Rong, Wenbing Huang, Tingyang Xu, Junzhou HuangICLR 2020 · 1,599 citations
- Measuring and Relieving the Over-Smoothing Problem for Graph Neural Networks from the Topological ViewDeli Chen, Yankai Lin, Wei Li, Peng Li et al.AAAI 2020 · 1,353 citations
- Graph Neural Networks Exponentially Lose Expressive Power for Node ClassificationKenta Oono, Taiji SuzukiICLR 2020 · 864 citations
- PairNorm: Tackling Oversmoothing in GNNsLingxiao Zhao, Leman AkogluICLR 2020 · 590 citations
Related papers
- GRAND+: Scalable Graph Random Neural NetworksWenzheng Feng, Yuxiao Dong, Tinglin Huang, Ziqi Yin et al.WWW 2022 · 56 citations
- Regularizing Graph Neural Networks via Consistency-Diversity Graph AugmentationsDeyu Bo, Binbin Hu, Xiao Wang, Zhiqiang Zhang et al.AAAI 2022 · 35 citations
- GRAND++: Graph Neural Diffusion with A Source TermMatthew Thorpe, Tan Minh Nguyen, Hedi Xia, Thomas Strohmer et al.ICLR 2022 · 108 citations
- NRGNN: Learning a Label Noise Resistant Graph Neural Network on Sparsely and Noisily Labeled GraphsEnyan Dai, Charu Aggarwal, Suhang WangKDD 2021 · 80 citations
- Hypergraph-enhanced Dual Semi-supervised Graph ClassificationWei Ju, Zhengyang Mao, Siyu Yi, Yifang Qin et al.ICML 2024 · 39 citations
