Dissecting the Diffusion Process in Linear Graph Convolutional Networks
Yifei Wang, Yisen Wang, Jiansheng Yang, Zhouchen Lin
摘要
Graph Convolutional Networks (GCNs) have attracted more and more attentions in recent years. A typical GCN layer consists of a linear feature propagation step and a nonlinear transformation step. Recent works show that a linear GCN can achieve comparable performance to the original non-linear GCN while being much more computationally efficient. In this paper, we dissect the feature propagation steps of linear GCNs from a perspective of continuous graph diffusion, and analyze why linear GCNs fail to benefit from more propagation steps. Following that, we propose Decoupled Graph Convolution (DGC) that decouples the terminal time and the feature propagation steps, making it more flexible and capable of exploiting a very large number of feature propagation steps. Experiments demonstrate that our proposed DGC improves linear GCNs by a large margin and makes them competitive with many modern variants of non-linear GCNs. Code is available at https://github.com/yifeiwang77/DGC .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper45
- GRAND++: Graph Neural Diffusion with A Source TermMatthew Thorpe, Tan Minh Nguyen, Hedi Xia, Thomas Strohmer 等ICLR 2022 · 被引用 108 次
- Cold Brew: Distilling Graph Node Representations with Incomplete or Missing NeighborhoodsWenqing Zheng, Edward W. Huang, Nikhil Rao, Sumeet Katariya 等ICLR 2022 · 被引用 85 次
- PC-Conv: Unifying Homophily and Heterophily with Two-Fold FilteringBingheng Li, Erlin Pan, Zhao KangAAAI 2024 · 被引用 67 次
- GREAD: Graph Neural Reaction-Diffusion NetworksJeongwhan Choi, Seoyoung Hong, Noseong Park, Sung-Bae ChoICML 2023 · 被引用 60 次
- On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph LearningAlvaro Arroyo, Alessio Gravina, Benjamin Gutteridge, Federico Barbero 等NeurIPS 2025 · 被引用 58 次
它引用的顶会 Paper3
- DropEdge: Towards Deep Graph Convolutional Networks on Node ClassificationYu Rong, Wenbing Huang, Tingyang Xu, Junzhou HuangICLR 2020 · 被引用 1,599 次
- PairNorm: Tackling Oversmoothing in GNNsLingxiao Zhao, Leman AkogluICLR 2020 · 被引用 590 次
- Continuous Graph Neural NetworksLouis-Pascal A. C. Xhonneux, Meng Qu, Jian TangICML 2020 · 被引用 194 次
相关 Paper
- On Provable Benefits of Depth in Training Graph Convolutional NetworksWeilin Cong, Morteza Ramezani, Mehrdad MahdaviNeurIPS 2021 · 被引用 93 次
- L2-GCN: Layer-Wise and Learned Efficient Training of Graph Convolutional NetworksYuning You, Tianlong Chen, Zhangyang Wang, Yang ShenCVPR 2020
- On the Equivalence of Decoupled Graph Convolution Network and Label PropagationHande Dong, Jiawei Chen, Fuli Feng, Xiangnan He 等WWW 2021 · 被引用 122 次
- G2CN: Graph Gaussian Convolution Networks with Concentrated Graph FiltersMingjie Li, Xiaojun Guo, Yifei Wang, Yisen Wang 等ICML 2022 · 被引用 25 次
- Adaptive Diffusion in Graph Neural NetworksJialin Zhao, Yuxiao Dong, Ming Ding, Evgeny Kharlamov 等NeurIPS 2021 · 被引用 83 次
