Oversmoothing, "Oversquashing", Heterophily, Long-Range, and more: Demystifying Common Beliefs in Graph Machine Learning
Adrián Arnaiz-Rodríguez, Federico Errica
摘要
After a renaissance phase in which researchers revisited the message-passing paradigm through the lens of deep learning, the graph machine learning community shifted its attention towards a deeper and practical understanding of message-passing's benefits and limitations. In this paper, we notice how the fast pace of progress around the topics of oversmoothing and oversquashing, the homophily-heterophily dichotomy, and long-range tasks, came with the consolidation of commonly accepted beliefs and assumptions -- under the form of universal statements -- that are not always true nor easy to distinguish from each other. We argue that this has led to ambiguities around the investigated problems, preventing researchers from focusing on and addressing precise research questions while causing a good amount of misunderstandings. Our contribution is to make such common beliefs explicit and encourage critical thinking around these topics, refuting universal statements via simple yet formally sufficient counterexamples. The end goal is to clarify conceptual differences, helping researchers address more clearly defined and targeted problems. The hope is to clarify the distinction between the different issues and promote separate but intertwined research directions to address them.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph LearningAlvaro Arroyo, Alessio Gravina, Benjamin Gutteridge, Federico Barbero 等NeurIPS 2025 · 被引用 58 次
- Return of ChebNet: Understanding and Improving an Overlooked GNN on Long Range TasksAli Hariri, Alvaro Arroyo, Alessio Gravina, Moshe Eliasof 等NeurIPS 2025 · 被引用 20 次
- Are we measuring oversmoothing in graph neural networks correctly?Kaicheng Zhang, Piero Deidda, Desmond Higham, Francesco TudiscoICLR 2026 · 被引用 7 次
- Adaptive Memory Retention in Dynamic GraphsFabrizio De Castelli, Alessio Gravina, Moshe Eliasof, Carola-Bibiane Schönlieb 等ICML 2026
它引用的顶会 Paper49
- Simple and Deep Graph Convolutional NetworksMing Chen, Zhewei Wei, Zengfeng Huang, Bolin Ding 等ICML 2020 · 被引用 1,910 次
- DropEdge: Towards Deep Graph Convolutional Networks on Node ClassificationYu Rong, Wenbing Huang, Tingyang Xu, Junzhou HuangICLR 2020 · 被引用 1,599 次
- DeepGCNs: Can GCNs Go As Deep As CNNs?Guohao Li, Matthias Müller, Ali K. Thabet, Bernard GhanemICCV 2019 · 被引用 1,586 次
- Beyond Homophily in Graph Neural Networks: Current Limitations and Effective DesignsJiong Zhu, Yujun Yan, Lingxiao Zhao, Mark Heimann 等NeurIPS 2020 · 被引用 1,490 次
- Geom-GCN: Geometric Graph Convolutional NetworksHongbin Pei, Bingzhe Wei, Kevin Chen-Chuan Chang, Yu Lei 等ICLR 2020 · 被引用 1,445 次
相关 Paper
- Multi-Track Message Passing: Tackling Oversmoothing and Oversquashing in Graph Learning via Preventing Heterophily MixingHongbin Pei, Yu Li, Huiqi Deng, Jingxin Hai 等ICML 2024 · 被引用 19 次
- Making Classic GNNs Strong Baselines Across Varying Homophily: A Smoothness-Generalization PerspectiveMing Gu, Zhuonan Zheng, Sheng Zhou, Meihan Liu 等NeurIPS 2025 · 被引用 4 次
- Sign is Not a Remedy: Multiset-to-Multiset Message Passing for Learning on Heterophilic GraphsLangzhang Liang, Sunwoo Kim, Kijung Shin, Zenglin Xu 等ICML 2024 · 被引用 13 次
- Diverse Message Passing for Attribute with HeterophilyLiang Yang, Mengzhe Li, Liyang Liu, Bingxin Niu 等NeurIPS 2021 · 被引用 95 次
- Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothingYunchong Song, Chenghu Zhou, Xinbing Wang, Zhouhan LinICLR 2023 · 被引用 18 次
