DeloopSGNN: Revisiting Spectral GNNs Through the Lens of Spatial Aggregation
Duanyu Li, Huijun Wu, Min Xie, Kai Lu, Wenzhe Zhang, Zhenwei Wu, Yong Dong, Ruibo Wang
摘要
Graph Neural Networks (GNNs) have been studied from two primary perspectives: spectral, which employs global graph signal filtering and is theoretically more expressive, and spatial, which builds on local neighborhood aggregation and generalizes well across diverse graph structures. While spectral GNNs are expected to perform better in theory, they often underperform in practice compared to spatial models. To better understand this gap, we introduce a novel theoretical framework for converting spectral GNNs into the spatial domain, allowing for more intuitive analysis. This transformation reveals that signal looping and repeated high-order aggregation are major causes of over-smoothing in spectral GNNs. By addressing these issues in the spatial domain and converting the model back to the spectral domain, we propose De-loopSGNN, a spectral GNN with improved expressive capacity. Experiments on benchmark datasets show that DeloopS-GNN achieves consistently strong performance in terms of accuracy and adversarial robustness, demonstrating that spectral GNNs can benefit significantly from careful architectural design grounded in our proposed framework.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper13
- Beyond Homophily in Graph Neural Networks: Current Limitations and Effective DesignsJiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann 等NeurIPS 2020 · 被引用 1,490 次
- Graph Neural Networks Exponentially Lose Expressive Power for Node ClassificationKenta Oono, Taiji SuzukiICLR 2020 · 被引用 864 次
- Beyond Low-frequency Information in Graph Convolutional NetworksDeyu Bo, Xiao Wang, Chuan Shi, Huawei ShenAAAI 2021 · 被引用 773 次
- GNNGuard: Defending Graph Neural Networks against Adversarial AttacksXiang Zhang, Marinka ZitnikNeurIPS 2020 · 被引用 416 次
- BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein ApproximationMingguo He, Zhewei Wei, Zengfeng Huang, Hongteng XuNeurIPS 2021 · 被引用 378 次
相关 Paper
- Analyzing the Expressive Power of Graph Neural Networks in a Spectral PerspectiveMuhammet Balcilar, Guillaume Renton, Pierre Héroux, Benoit Gaüzère 等ICLR 2021 · 被引用 44 次
- Dirichlet Energy Constrained Learning for Deep Graph Neural NetworksKaixiong Zhou, Xiao Huang, Daochen Zha, Rui Chen 等NeurIPS 2021 · 被引用 171 次
- Locality-Aware Graph Rewiring in GNNsFederico Barbero, Ameya Velingker, Amin Saberi, Michael M. Bronstein 等ICLR 2024 · 被引用 64 次
- Power up! Robust Graph Convolutional Network via Graph PoweringMing Jin, Heng Chang, Wenwu Zhu, Somayeh SojoudiAAAI 2021 · 被引用 31 次
- Towards Deeper Graph Neural NetworksMeng Liu, Hongyang Gao, Shuiwang JiKDD 2020 · 被引用 496 次
