MessageShift: Fine-Grained Data Augmentation for Graph Neural Networks
Weigang Lu, Zheng Liang, Yaming Yang, Ziyu Zheng, Meng Yan, Beilei Ling, Ziyu Guan, Wei Zhao
Abstract
Graph Neural Networks (GNNs) have become the dominant paradigm for machine learning on relational data, yet they remain susceptible to overfitting and noise in graph structures. While data augmentation has proven effective for regularization across domains, existing graph methods operate at coarse levels, such as perturbing entire structures or mixing node features. These approaches are context-agnostic and do not target the core computational process of GNNs: message passing. We introduce MessageShift, a novel fine-grained data augmentation paradigm that operates directly on the messages, the atomic units of information, as they flow through the GNN. The core idea is to apply a contextual perturbation to each message by shifting it towards or away from the center of its local neighborhood. This provides a rich regularization effect, capable of both smoothing noisy messages and sharpening distinctive ones. Extensive experiments on a wide range of benchmark datasets demonstrate that MessageShift consistently outperforms strong baselines across multiple GNN backbones.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get e3240064-2014-46cd-9c30-f5c259fade23Related papers
- DropMessage: Unifying Random Dropping for Graph Neural NetworksTaoran Fang, Zhiqing Xiao, Chunping Wang, Jiarong Xu et al.AAAI 2023 · 78 citations
- Robust Optimization as Data Augmentation for Large-scale GraphsKezhi Kong, Guohao Li, Mucong Ding, Zuxuan Wu et al.CVPR 2022 · 87 citations
- Graph Transplant: Node Saliency-Guided Graph Mixup with Local Structure PreservationJoonhyung Park, Hajin Shim, Eunho YangAAAI 2022 · 58 citations
- Local Augmentation for Graph Neural NetworksSongtao Liu, Rex Ying, Hanze Dong, Lanqing Li et al.ICML 2022 · 120 citations
- IntraMix: Intra-Class Mixup Generation for Accurate Labels and NeighborsShenghe Zheng, Hongzhi Wang, Xianglong LiuNeurIPS 2024 · 11 citations
