Minimax Sample Complexity of Graph Neural Networks: Lower Bounds and Structural Effects
Ahmad Ghasemi, Hossein Pishro-Nik
Abstract
Graph Neural Networks (GNNs) achieve strong empirical performance across domains, yet their fundamental statistical behavior remains poorly understood. This paper develops a minimax analysis of ReLU message-passing GNNs with explicit architectural assumptions, in both inductive (graph-level) and transductive (node-level) settings. For arbitrary graphs without structural constraints, we show that the worst-case generalization error scales as with sample size and input dimension , matching the behavior of feed-forward networks. Under a spectral--homophily condition combining strong label homophily and bounded spectral expansion, we prove a stronger minimax lower bound of for transductive node prediction. We complement these results with a systematic empirical study on three large-scale benchmarks (ogbn_arxiv, ogbn_products_50k, Reddit_50k) and two controlled synthetic datasets representing the worst-case and structured regimes of our theory. All benchmark graphs we study fall in the slow-mixing, bottlenecked regime captured by our spectral-homophily condition, and ratio-based scaling tests show error decay consistent with the rate in real and structured settings, while the worst-case synthetic dataset follows the curve. Together, these results indicate that practical GNN tasks often operate in the spectral-homophily regime, where our lower bound is tight and effective sample complexity is driven by graph topology rather than universal behavior.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7fc19545-d9ef-4192-b27e-8cfd5fc2299bBuilds on7
- Open Graph Benchmark: Datasets for Machine Learning on GraphsWeihua Hu, Matthias Fey, Marinka Zitnik, Yuxiao Dong et al.NeurIPS 2020 · 3,935 citations
- Graph Neural Networks Exponentially Lose Expressive Power for Node ClassificationKenta Oono, Taiji SuzukiICLR 2020 · 864 citations
- Generalization and Representational Limits of Graph Neural NetworksVikas K. Garg, Stefanie Jegelka, Tommi S. JaakkolaICML 2020 · 363 citations
- A PAC-Bayesian Approach to Generalization Bounds for Graph Neural NetworksRenjie Liao, Raquel Urtasun, Richard S. ZemelICLR 2021 · 109 citations
- Weisfeiler-Leman at the margin: When more expressivity mattersBilly Joe Franks, Christopher Morris, Ameya Velingker, Floris GeertsICML 2024 · 15 citations
Related papers
- What do Graph Neural Networks learn? Insights from Tropical GeometryTuan Anh Pham, Vikas GargNeurIPS 2024 · 5 citations
- Making Classic GNNs Strong Baselines Across Varying Homophily: A Smoothness-Generalization PerspectiveMing Gu, Zhuonan Zheng, Sheng Zhou, Meihan Liu et al.NeurIPS 2025 · 4 citations
- Predicting Global Label Relationship Matrix for Graph Neural Networks under HeterophilyLangzhang Liang, Xiangjing Hu, Zenglin Xu, Zixing Song et al.NeurIPS 2023 · 44 citations
- Generalization Analysis of Message Passing Neural Networks on Large Random GraphsSohir Maskey, Ron Levie, Yunseok Lee, Gitta KutyniokNeurIPS 2022 · 73 citations
- A Manifold Perspective on the Statistical Generalization of Graph Neural NetworksZhiyang Wang, Juan Cerviño, Alejandro RibeiroICML 2025
