NodeMixup: Tackling Under-Reaching for Graph Neural Networks
Weigang Lu, Ziyu Guan, Wei Zhao, Yaming Yang, Long Jin
Abstract
Graph Neural Networks (GNNs) have become mainstream methods for solving the semi-supervised node classification problem. However, due to the uneven location distribution of labeled nodes in the graph, labeled nodes are only accessible to a small portion of unlabeled nodes, leading to the under-reaching issue. In this study, we firstly reveal under-reaching by conducting an empirical investigation on various well-known graphs. Then, we demonstrate that under-reaching results in unsatisfactory distribution alignment between labeled and unlabeled nodes through systematic experimental analysis, significantly degrading GNNs' performance. To tackle under-reaching for GNNs, we propose an architecture-agnostic method dubbed NodeMixup. The fundamental idea is to (1) increase the reachability of labeled nodes by labeled-unlabeled pairs mixup, (2) leverage graph structures via fusing the neighbor connections of intra-class node pairs to improve performance gains of mixup, and (3) use neighbor label distribution similarity incorporating node degrees to determine sampling weights for node mixup. Extensive experiments demonstrate the efficacy of NodeMixup in assisting GNNs in handling under-reaching. The source code is available at https://github.com/WeigangLu/NodeMixup.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e5b12b2f-b7a6-4106-a3ac-9461aa150bceCited by top-tier papers12
- IntraMix: Intra-Class Mixup Generation for Accurate Labels and NeighborsShenghe Zheng, Hongzhi Wang, Xianglong LiuNeurIPS 2024 · 11 citations
- AdaGMLP: AdaBoosting GNN-to-MLP Knowledge DistillationWeigang Lu, Ziyu Guan, Wei Zhao, Yaming YangKDD 2024 · 10 citations
- AGMixup: Adaptive Graph Mixup for Semi-supervised Node ClassificationWeigang Lu, Ziyu Guan, Wei Zhao, Yaming Yang et al.AAAI 2025 · 6 citations
- Backward Oversmoothing: why is it hard to train deep Graph Neural Networks?Nicolas KerivenICML 2026 · 4 citations
- ViTE: Virtual Graph Trajectory Expert Router for Pedestrian Trajectory PredictionRuochen Li, Zhanxing Zhu, Tanqiu Qiao, Hubert P. H. ShumAAAI 2026 · 4 citations
Builds on13
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Simple and Deep Graph Convolutional NetworksMing Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding et al.ICML 2020 · 1,910 citations
- Graph Neural Networks Exponentially Lose Expressive Power for Node ClassificationKenta Oono, Taiji SuzukiICLR 2020 · 864 citations
- In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised LearningMamshad Nayeem Rizve, Kevin Duarte, Yogesh S. Rawat, Mubarak ShahICLR 2021 · 630 citations
- Understanding over-squashing and bottlenecks on graphs via curvatureJake Topping, Francesco Di Giovanni, Benjamin Paul Chamberlain, Xiaowen Dong et al.ICLR 2022 · 628 citations
Related papers
- Towards Label Position Bias in Graph Neural NetworksHaoyu Han, Xiaorui Liu, Feng Shi, MohamadAli Torkamani et al.NeurIPS 2023 · 8 citations
- iGraphMix: Input Graph Mixup Method for Node ClassificationJongwon Jeong, Hoyeop Lee, Hyui Geon Yoon, Beomyoung Lee et al.ICLR 2024 · 10 citations
- Normalize Then Propagate: Efficient Homophilous Regularization for Few-Shot Semi-Supervised Node ClassificationBaoming Zhang, Mingcai Chen, Jianqing Song, Shuangjie Li et al.AAAI 2025 · 1 citation
- NRGNN: Learning a Label Noise Resistant Graph Neural Network on Sparsely and Noisily Labeled GraphsEnyan Dai, Charu Aggarwal, Suhang WangKDD 2021 · 80 citations
- Mixup for Node and Graph ClassificationYiwei Wang, Wei Wang, Yuxuan Liang, Yujun Cai et al.WWW 2021 · 220 citations
