Pruning Spurious Subgraphs for Graph Out-of-Distribution Generalization
Tianjun Yao, Haoxuan Li, Yongqiang Chen, Tongliang Liu, Le Song, Eric P. Xing, Zhiqiang Shen
Abstract
Graph Neural Networks (GNNs) often encounter significant performance degradation under distribution shifts between training and test data, hindering their applicability in real-world scenarios. Recent studies have proposed various methods to address the out-of-distribution generalization challenge, with many methods in the graph domain focusing on directly identifying an invariant subgraph that is predictive of the target label. However, we argue that identifying the edges from the invariant subgraph directly is challenging and error-prone, especially when some spurious edges exhibit strong correlations with the targets. In this paper, we propose PrunE, the first pruning-based graph OOD method that eliminates spurious edges to improve OOD generalizability. By pruning spurious edges, PrunE retains the invariant subgraph more comprehensively, which is critical for OOD generalization. Specifically, PrunE employs two regularization terms to prune spurious edges: 1) graph size constraint to exclude uninformative spurious edges, and 2) -probability alignment to further suppress the occurrence of spurious edges. Through theoretical analysis and extensive experiments, we show that PrunE achieves superior OOD performance and outperforms previous state-of-the-art methods significantly. Codes are available at: https://github.com/tianyao-aka/PrunE-GraphOOD.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 35eba555-9fdf-4794-a41c-d6ee67d7c9c1Cited by top-tier papers1
Ask how each one uses itBuilds on39
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- WILDS: A Benchmark of in-the-Wild Distribution ShiftsPang Wei Koh, Shiori Sagawa, Henrik Marklund, Sang Michael Xie et al.ICML 2021 · 1,773 citations
- DropEdge: Towards Deep Graph Convolutional Networks on Node ClassificationYu Rong, Wenbing Huang, Tingyang Xu, Junzhou HuangICLR 2020 · 1,599 citations
- Distributionally Robust Neural NetworksShiori Sagawa, Pang Wei Koh, Tatsunori B. Hashimoto, Percy LiangICLR 2020 · 1,578 citations
- Out-of-Distribution Generalization via Risk Extrapolation (REx)David Krueger, Ethan Caballero, Jörn-Henrik Jacobsen, Amy Zhang et al.ICML 2021 · 1,163 citations
Related papers
- Disentangling Invariant Subgraph via Variance Contrastive Estimation under Distribution ShiftsHaoyang Li, Xin Wang, Xueling Zhu, Weigao Wen et al.ICML 2025
- Subgraph Aggregation for Out-of-Distribution Generalization on GraphsBowen Liu, Haoyang Li, Shuning Wang, Shuo Nie et al.AAAI 2025 · 7 citations
- Empowering Graph Invariance Learning with Deep Spurious InfomaxTianjun Yao, Yongqiang Chen, Zhenhao Chen, Kai Hu et al.ICML 2024 · 20 citations
- Disentangled Graph Self-supervised Learning for Out-of-Distribution GeneralizationHaoyang Li, Xin Wang, Zeyang Zhang, Haibo Chen et al.ICML 2024 · 13 citations
- A Structure-aware Invariant Learning Framework for Node-level Graph OOD GeneralizationRuiwen Yuan, Yongqiang Tang, Wensheng ZhangKDD 2025 · 4 citations
