Minimax Sample Complexity of Graph Neural Networks: Lower Bounds and Structural Effects
Ahmad Ghasemi, Hossein Pishro-Nik
摘要
Graph Neural Networks (GNNs) achieve strong empirical performance across domains, yet their fundamental statistical behavior remains poorly understood. This paper develops a minimax analysis of ReLU message-passing GNNs with explicit architectural assumptions, in both inductive (graph-level) and transductive (node-level) settings. For arbitrary graphs without structural constraints, we show that the worst-case generalization error scales as with sample size and input dimension , matching the behavior of feed-forward networks. Under a spectral--homophily condition combining strong label homophily and bounded spectral expansion, we prove a stronger minimax lower bound of for transductive node prediction. We complement these results with a systematic empirical study on three large-scale benchmarks (ogbn_arxiv, ogbn_products_50k, Reddit_50k) and two controlled synthetic datasets representing the worst-case and structured regimes of our theory. All benchmark graphs we study fall in the slow-mixing, bottlenecked regime captured by our spectral-homophily condition, and ratio-based scaling tests show error decay consistent with the rate in real and structured settings, while the worst-case synthetic dataset follows the curve. Together, these results indicate that practical GNN tasks often operate in the spectral-homophily regime, where our lower bound is tight and effective sample complexity is driven by graph topology rather than universal behavior.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong 等NeurIPS 2020 · 被引用 3,935 次
- Graph Neural Networks Exponentially Lose Expressive Power for Node ClassificationKenta Oono, Taiji SuzukiICLR 2020 · 被引用 864 次
- Generalization and Representational Limits of Graph Neural NetworksVikas K. Garg, Stefanie Jegelka, Tommi S. JaakkolaICML 2020 · 被引用 363 次
- A PAC-Bayesian Approach to Generalization Bounds for Graph Neural NetworksRenjie Liao, Raquel Urtasun, Richard S. ZemelICLR 2021 · 被引用 109 次
- Weisfeiler-Leman at the margin: When more expressivity mattersBilly Joe Franks, Christopher Morris, Ameya Velingker, Floris GeertsICML 2024 · 被引用 15 次
相关 Paper
- What do Graph Neural Networks learn? Insights from Tropical GeometryTuan Anh Pham, Vikas GargNeurIPS 2024 · 被引用 5 次
- Making Classic GNNs Strong Baselines Across Varying Homophily: A Smoothness-Generalization PerspectiveMing Gu, Zhuonan Zheng, Sheng Zhou, Meihan Liu 等NeurIPS 2025 · 被引用 4 次
- Predicting Global Label Relationship Matrix for Graph Neural Networks under HeterophilyLangzhang Liang, Xiangjing Hu, Zenglin Xu, Zixing Song 等NeurIPS 2023 · 被引用 44 次
- Generalization Analysis of Message Passing Neural Networks on Large Random GraphsSohir Maskey, Ron Levie, Yunseok Lee, Gitta KutyniokNeurIPS 2022 · 被引用 73 次
- A Manifold Perspective on the Statistical Generalization of Graph Neural NetworksZhiyang Wang, Juan Cerviño, Alejandro RibeiroICML 2025
