Sheaf Graph Neural Networks via PAC-Bayes Spectral Optimization
Yoonhyuk Choi, Jiho Choi, Taewook Ko, JongWook Kim, Chong-Kwon Kim
摘要
Over-smoothing in Graph Neural Networks (GNNs) causes collapse in distinct node features, particularly on heterophilic graphs where adjacent nodes often have dissimilar labels. Although sheaf neural networks partially mitigate this problem, they typically rely on static or heavily parameterized sheaf structures that hinder generalization and scalability. Existing sheaf-based models either predefine restriction maps or introduce excessive complexity, yet fail to provide rigorous stability guarantees. In this paper, we introduce a novel scheme called SGPC (Sheaf GNNs with PAC-Bayes Calibration), a unified architecture that combines cellular-sheaf message passing with several mechanisms, including optimal transport-based lifting, variance-reduced diffusion, and PAC-Bayes spectral regularization for robust semi-supervised node classification. We establish performance bounds theoretically and demonstrate that end-to-end training in linear computational complexity can achieve the resulting boundaware objective. Experiments on nine homophilic and heterophilic benchmarks show that SGPC outperforms state-ofthe-art spectral and sheaf-based GNNs while providing certified confidence intervals on unseen nodes. The code and proofs are in https://github.com/ChoiYoonHyuk/SGPC .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper12
- Simple and Deep Graph Convolutional NetworksMing Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding 等ICML 2020 · 被引用 1,910 次
- Beyond Homophily in Graph Neural Networks: Current Limitations and Effective DesignsJiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann 等NeurIPS 2020 · 被引用 1,490 次
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei 等ICLR 2020 · 被引用 1,445 次
- Beyond Low-frequency Information in Graph Convolutional NetworksDeyu Bo, Xiao Wang, Chuan Shi, Huawei ShenAAAI 2021 · 被引用 773 次
- Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNsCristian Bodnar, Francesco Di Giovanni, Benjamin Paul Chamberlain, Pietro Lió 等NeurIPS 2022 · 被引用 313 次
相关 Paper
- Cooperative Sheaf Neural NetworksAndré Ribeiro, Ana Luiza Tenorio, Juan Belieni, Amauri H Souza 等ICLR 2026 · 被引用 13 次
- p-Laplacian Based Graph Neural NetworksGuoji Fu, Peilin Zhao, Yatao BianICML 2022 · 被引用 53 次
- Bundle Neural Network for message diffusion on graphsJacob Bamberger, Federico Barbero, Xiaowen Dong, Michael M. BronsteinICLR 2025
- A PAC-Bayesian Approach to Generalization Bounds for Graph Neural NetworksRenjie Liao, Raquel Urtasun, Richard S. ZemelICLR 2021 · 被引用 109 次
- Going Deep: Graph Convolutional Ladder-Shape NetworksRuiqi Hu, Shirui Pan, Guodong Long, Qinghua Lu 等AAAI 2020 · 被引用 28 次
