On the VC dimension of deep group convolutional neural networks
Anna Sepliarskaia, Sophie Langer, Johannes Schmidt-Hieber
摘要
We study the generalization capabilities of Group Convolutional Neural Networks (GCNNs) with ReLU activation function by deriving upper and lower bounds for their Vapnik-Chervonenkis (VC) dimension. Specifically, we analyze how factors such as the number of layers, weights, and input dimension affect the VC dimension. We further compare the derived bounds to those known for other types of neural networks. Our findings extend previous results on the VC dimension of continuous GCNNs with two layers, thereby providing new insights into the generalization properties of GCNNs, particularly regarding the dependence on the input resolution of the data.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper9
- SE(3)-Transformers: 3D Roto-Translation Equivariant Attention NetworksFabian Fuchs, Daniel E. Worrall, Volker Fischer, Max WellingNeurIPS 2020 · 被引用 1,025 次
- Incorporating Symmetry into Deep Dynamics Models for Improved GeneralizationRui Wang, Robin Walters, Rose YuICLR 2021 · 被引用 201 次
- B-Spline CNNs on Lie groupsErik J. BekkersICLR 2020 · 被引用 155 次
- Automatic Symmetry Discovery with Lie Algebra Convolutional NetworkNima Dehmamy, Robin Walters, Yanchen Liu, Dashun Wang 等NeurIPS 2021 · 被引用 120 次
- Provably Strict Generalisation Benefit for Equivariant ModelsBryn Elesedy, Sheheryar ZaidiICML 2021 · 被引用 100 次
相关 Paper
- WL meet VCChristopher Morris, Floris Geerts, Jan Tönshoff, Martin GroheICML 2023 · 被引用 36 次
- Generalization and Representational Limits of Graph Neural NetworksVikas K. Garg, Stefanie Jegelka, Tommi S. JaakkolaICML 2020 · 被引用 363 次
- A PAC-Bayesian Approach to Generalization Bounds for Graph Neural NetworksRenjie Liao, Raquel Urtasun, Richard S. ZemelICLR 2021 · 被引用 109 次
- What do Graph Neural Networks learn? Insights from Tropical GeometryTuan Anh Pham, Vikas GargNeurIPS 2024 · 被引用 5 次
- On the Nonlinearity of Layer NormalizationYunhao Ni, Yuxin Guo, Junlong Jia, Lei HuangICML 2024 · 被引用 9 次
