BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximation
Mingguo He, Zhewei Wei, Zengfeng Huang, Hongteng Xu
Abstract
Many representative graph neural networks, e.g., GPR-GNN and ChebNet, approximate graph convolutions with graph spectral filters. However, existing work either applies predefined filter weights or learns them without necessary constraints, which may lead to oversimplified or ill-posed filters. To overcome these issues, we propose BernNet, a novel graph neural network with theoretical support that provides a simple but effective scheme for designing and learning arbitrary graph spectral filters. In particular, for any filter over the normalized Laplacian spectrum of a graph, our BernNet estimates it by an order- Bernstein polynomial approximation and designs its spectral property by setting the coefficients of the Bernstein basis. Moreover, we can learn the coefficients (and the corresponding filter weights) based on observed graphs and their associated signals and thus achieve the BernNet specialized for the data. Our experiments demonstrate that BernNet can learn arbitrary spectral filters, including complicated band-rejection and comb filters, and it achieves superior performance in real-world graph modeling tasks. Code is available at https://github.com/ivam-he/BernNet.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext da531bb1-b6b7-4a95-a75d-6d4dab9bb8d3Cited by top-tier papers101
- Revisiting Heterophily For Graph Neural NetworksSitao Luan, Chenqing Hua, Qincheng Lu, Jiaqi Zhu et al.NeurIPS 2022 · 351 citations
- How Powerful are Spectral Graph Neural NetworksXiyuan Wang, Muhan ZhangICML 2022 · 309 citations
- One For All: Towards Training One Graph Model For All Classification TasksHao Liu, Jiarui Feng, Lecheng Kong, Ningyue Liang et al.ICLR 2024 · 253 citations
- Convolutional Neural Networks on Graphs with Chebyshev Approximation, RevisitedMingguo He, Zhewei Wei, Ji-Rong WenNeurIPS 2022 · 220 citations
- When Do Graph Neural Networks Help with Node Classification? Investigating the Homophily Principle on Node DistinguishabilitySitao Luan, Chenqing Hua, Minkai Xu, Qincheng Lu et al.NeurIPS 2023 · 118 citations
Builds on5
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei et al.ICLR 2020 · 1,445 citations
- Towards Deeper Graph Neural NetworksMeng Liu, Hongyang Gao, Shuiwang JiKDD 2020 · 496 citations
- Interpreting and Unifying Graph Neural Networks with An Optimization FrameworkMeiqi Zhu, Xiao Wang, Chuan Shi, Houye Ji et al.WWW 2021 · 233 citations
- Adaptive Universal Generalized PageRank Graph Neural NetworkEli Chien, Jianhao Peng, Pan Li, Olgica MilenkovicICLR 2021 · 93 citations
- Analyzing the Expressive Power of Graph Neural Networks in a Spectral PerspectiveMuhammet Balcilar, Guillaume Renton, Pierre Héroux, Benoit Gaüzère et al.ICLR 2021 · 44 citations
Related papers
- Unifying Homophily and Heterophily for Spectral Graph Neural Networks via Triple Filter EnsemblesRui Duan, Mingjian Guang, Junli Wang, Chungang Yan et al.NeurIPS 2024 · 31 citations
- Graph Neural Networks with Diverse Spectral FilteringJingwei Guo, Kaizhu Huang, Xinping Yi, Rui ZhangWWW 2023 · 21 citations
- Specformer: Spectral Graph Neural Networks Meet TransformersDeyu Bo, Chuan Shi, Lele Wang, Renjie LiaoICLR 2023 · 16 citations
- Designing Specialized Two-Dimensional Graph Spectral Filters for Spatial-Temporal Graph ModelingYuxin Chen, Fangru Lin, Jingyi Huo, Hui YanAAAI 2025 · 5 citations
- Adaptive Kernel Graph Neural NetworkMingxuan Ju, Shifu Hou, Yujie Fan, Jianan Zhao et al.AAAI 2022 · 33 citations
