GREAD: Graph Neural Reaction-Diffusion Networks
Jeongwhan Choi, Seoyoung Hong, Noseong Park, Sung-Bae Cho
Abstract
Graph neural networks (GNNs) are one of the most popular research topics for deep learning. GNN methods typically have been designed on top of the graph signal processing theory. In particular, diffusion equations have been widely used for designing the core processing layer of GNNs, and therefore they are inevitably vulnerable to the notorious oversmoothing problem. Recently, a couple of papers paid attention to reaction equations in conjunctions with diffusion equations. However, they all consider limited forms of reaction equations. To this end, we present a reaction-diffusion equation-based GNN method that considers all popular types of reaction equations in addition to one special reaction equation designed by us. To our knowledge, our paper is one of the most comprehensive studies on reaction-diffusion equation-based GNNs. In our experiments with 9 datasets and 28 baselines, our method, called GREAD, outperforms them in a majority of cases. Further synthetic data experiments show that it mitigates the oversmoothing problem and works well for various homophily rates.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5b37bc8a-b180-466a-af91-03d899193e6bCited by top-tier papers23
- An Attentive Inductive Bias for Sequential Recommendation beyond the Self-AttentionYehjin Shin, Jeongwhan Choi, Hyowon Wi, Noseong ParkAAAI 2024 · 130 citations
- A Fractional Graph Laplacian Approach to OversmoothingSohir Maskey, Raffaele Paolino, Aras Bacho, Gitta KutyniokNeurIPS 2023 · 66 citations
- Graph Convolutions Enrich the Self-Attention in Transformers!Jeongwhan Choi, Hyowon Wi, Jayoung Kim, Yehjin Shin et al.NeurIPS 2024 · 24 citations
- On Oversquashing in Graph Neural Networks Through the Lens of Dynamical SystemsAlessio Gravina, Moshe Eliasof, Claudio Gallicchio, Davide Bacciu et al.AAAI 2025 · 22 citations
- Unleashing the Potential of Fractional Calculus in Graph Neural Networks with FRONDQiyu Kang, Kai Zhao, Qinxu Ding, Feng Ji et al.ICLR 2024 · 21 citations
Builds on22
- Simple and Deep Graph Convolutional NetworksMing Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding et al.ICML 2020 · 1,910 citations
- Beyond Homophily in Graph Neural Networks: Current Limitations and Effective DesignsJiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann et al.NeurIPS 2020 · 1,490 citations
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei et al.ICLR 2020 · 1,445 citations
- Graph Neural Networks Exponentially Lose Expressive Power for Node ClassificationKenta Oono, Taiji SuzukiICLR 2020 · 864 citations
- Beyond Low-frequency Information in Graph Convolutional NetworksDeyu Bo, Xiao Wang, Chuan Shi, Huawei ShenAAAI 2021 · 773 citations
Related papers
- Graph Navier-Stokes NetworksZexing Zhao, Guangsi Shi, Yu Gong, Tianyu Wang et al.KDD 2026
- Feature Transportation Improves Graph Neural NetworksMoshe Eliasof, Eldad Haber, Eran TreisterAAAI 2024 · 26 citations
- GRAND: Graph Neural DiffusionBen Chamberlain, James Rowbottom, Maria I. Gorinova, Michael M. Bronstein et al.ICML 2021 · 358 citations
- Flexible Graph Neural Diffusion with Latent Class Representation LearningLiangtian Wan, Huijin Han, Lu Sun, Zixun Zhang et al.KDD 2024 · 2 citations
- Gradient Gating for Deep Multi-Rate Learning on GraphsT. Konstantin Rusch, Benjamin Paul Chamberlain, Michael W. Mahoney, Michael M. Bronstein et al.ICLR 2023 · 6 citations
