Training Robust Graph Neural Networks by Modeling Noise Dependencies
Yeonjun In, Kanghoon Yoon, Sukwon Yun, Kibum Kim, Sungchul Kim, Chanyoung Park
Abstract
In real-world applications, node features in graphs often contain noise from various sources, leading to significant performance degradation in GNNs. Although several methods have been developed to enhance robustness, they rely on the unrealistic assumption that noise in node features is independent of the graph structure and node labels, thereby limiting their applicability. To this end, we introduce a more realistic noise scenario, dependency-aware noise on graphs (DANG), where noise in node features create a chain of noise dependencies that propagates to the graph structure and node labels. We propose a novel robust GNN, DA-GNN, which captures the causal relationships among variables in the data generating process (DGP) of DANG using variational inference. In addition, we present new benchmark datasets that simulate DANG in real-world applications, enabling more practical research on robust GNNs. Extensive experiments demonstrate that DA-GNN consistently outperforms existing baselines across various noise scenarios, including both DANG and conventional noise models commonly considered in this field. Our code is available at https://github.com/yeonjun-in/torch-DA-GNN.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext dd25aa20-e404-40a4-9fdc-771da520905dBuilds on19
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Graph Structure Learning for Robust Graph Neural NetworksWei Jin, Yao Ma, Xiaorui Liu, Xianfeng Tang et al.KDD 2020 · 604 citations
- SLAPS: Self-Supervision Improves Structure Learning for Graph Neural NetworksBahare Fatemi, Layla El Asri, Seyed Mehran KazemiNeurIPS 2021 · 220 citations
- Confidence Scores Make Instance-dependent Label-noise Learning PossibleAntonin Berthon, Bo Han, Gang Niu, Tongliang Liu et al.ICML 2021 · 126 citations
- Instance-dependent Label-noise Learning under a Structural Causal ModelYu Yao, Tongliang Liu, Mingming Gong, Bo Han et al.NeurIPS 2021 · 100 citations
Related papers
- NRGNN: Learning a Label Noise Resistant Graph Neural Network on Sparsely and Noisily Labeled GraphsEnyan Dai, Charu Aggarwal, Suhang WangKDD 2021 · 80 citations
- Expressive Graph Neural Networks via Equivariant Use of NoiseXiyuan Wang, Muhan ZhangICML 2026
- Divide and Denoise: Empowering Simple Models for Robust Semi-Supervised Node Classification against Label NoiseKaize Ding, Xiaoxiao Ma, Yixin Liu, Shirui PanKDD 2024 · 8 citations
- Robust Optimization as Data Augmentation for Large-scale GraphsKezhi Kong, Guohao Li, Mucong Ding, Zuxuan Wu et al.CVPR 2022 · 87 citations
- GD: Robust Graph Learning under Label Noise via Dual-View Prediction DiscrepancyKailai Li, Jiong Lou, Jiawei Sun, Honghong Zeng et al.NeurIPS 2025
