On the VC dimension of deep group convolutional neural networks
Anna Sepliarskaia, Sophie Langer, Johannes Schmidt-Hieber
Abstract
We study the generalization capabilities of Group Convolutional Neural Networks (GCNNs) with ReLU activation function by deriving upper and lower bounds for their Vapnik-Chervonenkis (VC) dimension. Specifically, we analyze how factors such as the number of layers, weights, and input dimension affect the VC dimension. We further compare the derived bounds to those known for other types of neural networks. Our findings extend previous results on the VC dimension of continuous GCNNs with two layers, thereby providing new insights into the generalization properties of GCNNs, particularly regarding the dependence on the input resolution of the data.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 87af76c9-0e6d-4212-b84d-3dfa939813ebBuilds on9
- SE(3)-Transformers: 3D Roto-Translation Equivariant Attention NetworksFabian Fuchs, Daniel E. Worrall, Volker Fischer, Max WellingNeurIPS 2020 · 1,025 citations
- Incorporating Symmetry into Deep Dynamics Models for Improved GeneralizationRui Wang, Robin Walters, Rose YuICLR 2021 · 201 citations
- B-Spline CNNs on Lie groupsErik J. BekkersICLR 2020 · 155 citations
- Automatic Symmetry Discovery with Lie Algebra Convolutional NetworkNima Dehmamy, Robin Walters, Yanchen Liu, Dashun Wang et al.NeurIPS 2021 · 120 citations
- Provably Strict Generalisation Benefit for Equivariant ModelsBryn Elesedy, Sheheryar ZaidiICML 2021 · 100 citations
Related papers
- WL meet VCChristopher Morris, Floris Geerts, Jan Tönshoff, Martin GroheICML 2023 · 36 citations
- Generalization and Representational Limits of Graph Neural NetworksVikas K. Garg, Stefanie Jegelka, Tommi S. JaakkolaICML 2020 · 363 citations
- A PAC-Bayesian Approach to Generalization Bounds for Graph Neural NetworksRenjie Liao, Raquel Urtasun, Richard S. ZemelICLR 2021 · 109 citations
- What do Graph Neural Networks learn? Insights from Tropical GeometryTuan Anh Pham, Vikas GargNeurIPS 2024 · 5 citations
- On the Nonlinearity of Layer NormalizationYunhao Ni, Yuxin Guo, Junlong Jia, Lei HuangICML 2024 · 9 citations
