Towards Better Graph Representation Learning with Parameterized Decomposition & Filtering
Mingqi Yang, Wenjie Feng, Yanming Shen, Bryan Hooi
Abstract
Proposing an effective and flexible matrix to represent a graph is a fundamental challenge that has been explored from multiple perspectives, e.g., filtering in Graph Fourier Transforms. In this work, we develop a novel and general framework which unifies many existing GNN models from the view of parameterized decomposition and filtering, and show how it helps to enhance the flexibility of GNNs while alleviating the smoothness and amplification issues of existing models. Essentially, we show that the extensively studied spectral graph convolutions with learnable polynomial filters are constrained variants of this formulation, and releasing these constraints enables our model to express the desired decomposition and filtering simultaneously. Based on this generalized framework, we develop models that are simple in implementation but achieve significant improvements and computational efficiency on a variety of graph learning tasks. Code is available at https://github.com/qslim/PDF .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b46acb34-715e-4dc6-8c64-c8f6a6584d19Cited by top-tier papers3
- Spatio-Spectral Graph Neural NetworksSimon Geisler, Arthur Kosmala, Daniel Herbst, Stephan GünnemannNeurIPS 2024 · 37 citations
- Unifying Homophily and Heterophily for Spectral Graph Neural Networks via Triple Filter EnsemblesRui Duan, Mingjian Guang, Junli Wang, Chungang Yan et al.NeurIPS 2024 · 31 citations
- GraphGPT: Generative Pre-trained Graph Eulerian TransformerQifang Zhao, Weidong Ren, Tianyu Li, Hong Liu et al.ICML 2025
Builds on18
- Simple and Deep Graph Convolutional NetworksMing Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding et al.ICML 2020 · 1,910 citations
- Principal Neighbourhood Aggregation for Graph NetsGabriele Corso, Luca Cavalleri, Dominique Beaini, Pietro Liò et al.NeurIPS 2020 · 914 citations
- Graph Neural Networks Exponentially Lose Expressive Power for Node ClassificationKenta Oono, Taiji SuzukiICLR 2020 · 864 citations
- Rethinking Graph Transformers with Spectral AttentionDevin Kreuzer, Dominique Beaini, William L. Hamilton, Vincent Létourneau et al.NeurIPS 2021 · 854 citations
- PairNorm: Tackling Oversmoothing in GNNsLingxiao Zhao, Leman AkogluICLR 2020 · 590 citations
Related papers
- A New Perspective on the Effects of Spectrum in Graph Neural NetworksMingqi Yang, Yanming Shen, Rui Li, Heng Qi et al.ICML 2022 · 37 citations
- Specformer: Spectral Graph Neural Networks Meet TransformersDeyu Bo, Chuan Shi, Lele Wang, Renjie LiaoICLR 2023 · 16 citations
- Adaptive Kernel Graph Neural NetworkMingxuan Ju, Shifu Hou, Yujie Fan, Jianan Zhao et al.AAAI 2022 · 33 citations
- How Universal Polynomial Bases Enhance Spectral Graph Neural Networks: Heterophily, Over-smoothing, and Over-squashingKeke Huang, Yu Guang Wang, Ming Li, Pietro LioICML 2024 · 62 citations
- Pyramid Graph Neural Network: A Graph Sampling and Filtering Approach for Multi-scale Disentangled RepresentationsHaoyu Geng, Chao Chen, Yixuan He, Gang Zeng et al.KDD 2023 · 8 citations
