Normalize Then Propagate: Efficient Homophilous Regularization for Few-Shot Semi-Supervised Node Classification
Baoming Zhang, Mingcai Chen, Jianqing Song, Shuangjie Li, Jie Zhang, Chongjun Wang
Abstract
Graph Neural Networks (GNNs) have demonstrated remarkable ability in semi-supervised node classification. However, most existing GNNs rely heavily on a large amount of labeled data for training, which is labor-intensive and requires extensive domain knowledge. In this paper, we first analyze the restrictions of GNNs generalization from the perspective of supervision signals in the context of few-shot semi-supervised node classification. To address these challenges, we propose a novel algorithm named NormProp, which utilizes the homophily assumption of unlabeled nodes to generate additional supervision signals, thereby enhancing the generalization against label scarcity. The key idea is to efficiently capture both the class information and the consistency of aggregation during message passing, via decoupling the direction and Euclidean norm of node representations. Moreover, we conduct a theoretical analysis to determine the upper bound of Euclidean norm, and then propose homophilous regularization to constraint the consistency of unlabeled nodes. Extensive experiments demonstrate that NormProp achieve state-of-the-art performance under low-label rate scenarios with low computational complexity.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on14
- Simple and Deep Graph Convolutional NetworksMing Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding et al.ICML 2020 · 1,910 citations
- Graph Random Neural Networks for Semi-Supervised Learning on GraphsWenzheng Feng, Jie Zhang, Yuxiao Dong, Yu Han et al.NeurIPS 2020 · 526 citations
- Towards Deeper Graph Neural NetworksMeng Liu, Hongyang Gao, Shuiwang JiKDD 2020 · 496 citations
- Combining Label Propagation and Simple Models out-performs Graph Neural NetworksQian Huang, Horace He, Abhay Singh, Ser-Nam Lim et al.ICLR 2021 · 322 citations
- Multi-Stage Self-Supervised Learning for Graph Convolutional Networks on Graphs with Few Labeled NodesKe Sun, Zhouchen Lin, Zhanxing ZhuAAAI 2020 · 304 citations
Related papers
- Regularizing Graph Neural Networks via Consistency-Diversity Graph AugmentationsDeyu Bo, Binbin Hu, Xiao Wang, Zhiqiang Zhang et al.AAAI 2022 · 35 citations
- Meta Propagation Networks for Graph Few-shot Semi-supervised LearningKaize Ding, Jianling Wang, James Caverlee, Huan LiuAAAI 2022 · 56 citations
- p-Laplacian Based Graph Neural NetworksGuoji Fu, Peilin Zhao, Yatao BianICML 2022 · 53 citations
- NodeMixup: Tackling Under-Reaching for Graph Neural NetworksWeigang Lu, Ziyu Guan, Wei Zhao, Yaming Yang et al.AAAI 2024 · 29 citations
- Graph Few-Shot Learning via Knowledge TransferHuaxiu Yao, Chuxu Zhang, Ying Wei, Meng Jiang et al.AAAI 2020 · 193 citations
