Effective Structural Encodings via Local Curvature Profiles
Lukas Fesser, Melanie Weber
摘要
Structural and Positional Encodings can significantly improve the performance of Graph Neural Networks in downstream tasks. Recent literature has begun to systematically investigate differences in the structural properties that these approaches encode, as well as performance trade-offs between them. However, the question of which structural properties yield the most effective encoding remains open. In this paper, we investigate this question from a geometric perspective. We propose a novel structural encoding based on discrete Ricci curvature (Local Curvature Profiles, short LCP ) and show that it significantly outperforms existing encoding approaches. We further show that combining local structural encodings, such as LCP, with global positional encodings improves downstream performance, suggesting that they capture complementary geometric information. Finally, we compare different encoding types with (curvature-based) rewiring techniques. Rewiring has recently received a surge of interest due to its ability to improve the performance of Graph Neural Networks by mitigating over-smoothing and over-squashing effects. Our results suggest that utilizing curvature information for structural encodings delivers significantly larger performance increases than rewiring. 1
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper4
- Higher-Order Learning with Graph Neural Networks via Hypergraph EncodingsRaphaël Pellegrin, Lukas Fesser, Melanie WeberNeurIPS 2025 · 被引用 2 次
- Balancing Efficiency and Expressiveness: Subgraph GNNs with Walk-Based CentralityJoshua Southern, Yam Eitan, Guy Bar-Shalom, Michael M. Bronstein 等ICML 2025
- Recovering Manifold Structure Using Ollivier Ricci CurvatureTristan Luca Saidi, Abigail Hickok, Andrew J. BlumbergICLR 2025
- Unitary Convolutions for Message-passing and Positional Encodings on Directed GraphsLukas Fesser, Bobak Kiani, Melanie WeberICML 2026
它引用的顶会 Paper12
- Recipe for a General, Powerful, Scalable Graph TransformerLadislav Rampásek, Michael Galkin, Vijay Prakash Dwivedi, Anh Tuan Luu 等NeurIPS 2022 · 被引用 1,216 次
- Rethinking Graph Transformers with Spectral AttentionDevin Kreuzer, Dominique Beaini, William L. Hamilton, Vincent Létourneau 等NeurIPS 2021 · 被引用 854 次
- Understanding over-squashing and bottlenecks on graphs via curvatureJake Topping, Francesco Di Giovanni, Benjamin Paul Chamberlain, Xiaowen Dong 等ICLR 2022 · 被引用 628 次
- Graph Neural Networks with Learnable Structural and Positional RepresentationsVijay Prakash Dwivedi, Anh Tuan Luu, Thomas Laurent, Yoshua Bengio 等ICLR 2022 · 被引用 464 次
- Distance Encoding: Design Provably More Powerful Neural Networks for Graph Representation LearningPan Li, Yanbang Wang, Hongwei Wang, Jure LeskovecNeurIPS 2020 · 被引用 391 次
相关 Paper
- Curvature Graph NetworkZe Ye, Kin Sum Liu, Tengfei Ma, Jie Gao 等ICLR 2020 · 被引用 81 次
- Discrete Curvature Graph Information BottleneckXingcheng Fu, Jian Wang, Yisen Gao, Qingyun Sun 等AAAI 2025 · 被引用 4 次
- Revisiting Over-smoothing and Over-squashing Using Ollivier-Ricci CurvatureKhang Nguyen, Nong Minh Hieu, Vinh Duc Nguyen, Nhat Ho 等ICML 2023 · 被引用 110 次
- LEAP: Local ECT-Based Learnable Positional Encodings for GraphsJuan Amboage, Ernst Röell, Patrick Schnider, Bastian RieckICLR 2026 · 被引用 3 次
- Rotary Position Encodings for GraphsIsaac Reid, Arijit Sehanobish, Cederik Höfs, Bruno Mlodozeniec 等ICML 2026
