Enhancing Spectral GNNs: From Topology and Perturbation Perspectives
Taoyang Qin, Ke-Jia Chen, Zheng Liu
Abstract
Spectral Graph Neural Networks process graph signals using the spectral properties of the normalized graph Laplacian matrix. However, the frequent occurrence of repeated eigenvalues limits the expressiveness of spectral GNNs. To address this, we propose a higher-dimensional sheaf Laplacian matrix, which not only encodes the graph's topological information but also increases the upper bound on the number of distinct eigenvalues. The sheaf Laplacian matrix is derived from carefully designed perturbations of the block form of the normalized graph Laplacian, yielding a perturbed sheaf Laplacian (PSL) matrix with more distinct eigenvalues. We provide a theoretical analysis of the expressiveness of spectral GNNs equipped with the PSL and establish perturbation bounds for the eigenvalues. Extensive experiments on benchmark datasets for node classification demonstrate that incorporating the perturbed sheaf Laplacian enhances the performance of spectral GNNs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 993b3fac-fd62-40f7-a394-76405587be48Builds on9
- Can Graph Neural Networks Count Substructures?Zhengdao Chen, Lei Chen, Soledad Villar, Joan BrunaNeurIPS 2020 · 392 citations
- Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNsCristian Bodnar, Francesco Di Giovanni, Benjamin Paul Chamberlain, Pietro Lió et al.NeurIPS 2022 · 313 citations
- How Powerful are Spectral Graph Neural NetworksXiyuan Wang, Muhan ZhangICML 2022 · 309 citations
- Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation LearningMuhan Zhang, Pan Li, Yinglong Xia, Kai Wang et al.NeurIPS 2021 · 255 citations
- Adaptive Universal Generalized PageRank Graph Neural NetworkEli Chien, Jianhao Peng, Pan Li, Olgica MilenkovicICLR 2021 · 93 citations
Related papers
- Sheaf Neural Networks on SPD Manifolds: Second-Order Geometric Representation LearningYuhan Peng, Junwen Dong, Yuzhi Zeng, Hao Li et al.ICML 2026 · 1 citation
- Improving Expressive Power of Spectral Graph Neural Networks with Eigenvalue CorrectionKangkang Lu, Yanhua Yu, Hao Fei, Xuan Li et al.AAAI 2024 · 10 citations
- Sheaves Reloaded: A Direction AwakeningStefano Fiorini, Hakan Emre Aktas, Iulia Duta, Pietro Morerio et al.ICLR 2026
- High-Pass Matters: Theoretical Insights and Sheaflet-Based Design for Hypergraph Neural NetworksMing Li, Yujie Fang, Dongrui Shen, Han Feng et al.AAAI 2026 · 1 citation
- Cooperative Sheaf Neural NetworksAndré Ribeiro, Ana Luiza Tenorio, Juan Belieni, Amauri H Souza et al.ICLR 2026 · 13 citations
