Dissecting the Diffusion Process in Linear Graph Convolutional Networks
Yifei Wang, Yisen Wang, Jiansheng Yang, Zhouchen Lin
Abstract
Graph Convolutional Networks (GCNs) have attracted more and more attentions in recent years. A typical GCN layer consists of a linear feature propagation step and a nonlinear transformation step. Recent works show that a linear GCN can achieve comparable performance to the original non-linear GCN while being much more computationally efficient. In this paper, we dissect the feature propagation steps of linear GCNs from a perspective of continuous graph diffusion, and analyze why linear GCNs fail to benefit from more propagation steps. Following that, we propose Decoupled Graph Convolution (DGC) that decouples the terminal time and the feature propagation steps, making it more flexible and capable of exploiting a very large number of feature propagation steps. Experiments demonstrate that our proposed DGC improves linear GCNs by a large margin and makes them competitive with many modern variants of non-linear GCNs. Code is available at https://github.com/yifeiwang77/DGC .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ca8c3aba-e387-4fa1-af0c-90052cd12b77Cited by top-tier papers45
- GRAND++: Graph Neural Diffusion with A Source TermMatthew Thorpe, Tan Minh Nguyen, Hedi Xia, Thomas Strohmer et al.ICLR 2022 · 108 citations
- Cold Brew: Distilling Graph Node Representations with Incomplete or Missing NeighborhoodsWenqing Zheng, Edward W. Huang, Nikhil Rao, Sumeet Katariya et al.ICLR 2022 · 85 citations
- PC-Conv: Unifying Homophily and Heterophily with Two-Fold FilteringBingheng Li, Erlin Pan, Zhao KangAAAI 2024 · 67 citations
- GREAD: Graph Neural Reaction-Diffusion NetworksJeongwhan Choi, Seoyoung Hong, Noseong Park, Sung-Bae ChoICML 2023 · 60 citations
- On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph LearningAlvaro Arroyo, Alessio Gravina, Benjamin Gutteridge, Federico Barbero et al.NeurIPS 2025 · 58 citations
Builds on3
- DropEdge: Towards Deep Graph Convolutional Networks on Node ClassificationYu Rong, Wenbing Huang, Tingyang Xu, Junzhou HuangICLR 2020 · 1,599 citations
- PairNorm: Tackling Oversmoothing in GNNsLingxiao Zhao, Leman AkogluICLR 2020 · 590 citations
- Continuous Graph Neural NetworksLouis-Pascal A. C. Xhonneux, Meng Qu, Jian TangICML 2020 · 194 citations
Related papers
- On Provable Benefits of Depth in Training Graph Convolutional NetworksWeilin Cong, Morteza Ramezani, Mehrdad MahdaviNeurIPS 2021 · 93 citations
- L2-GCN: Layer-Wise and Learned Efficient Training of Graph Convolutional NetworksYuning You, Tianlong Chen, Zhangyang Wang, Yang ShenCVPR 2020
- On the Equivalence of Decoupled Graph Convolution Network and Label PropagationHande Dong, Jiawei Chen, Fuli Feng, Xiangnan He et al.WWW 2021 · 122 citations
- G2CN: Graph Gaussian Convolution Networks with Concentrated Graph FiltersMingjie Li, Xiaojun Guo, Yifei Wang, Yisen Wang et al.ICML 2022 · 25 citations
- Adaptive Diffusion in Graph Neural NetworksJialin Zhao, Yuxiao Dong, Ming Ding, Evgeny Kharlamov et al.NeurIPS 2021 · 83 citations
