Effective Structural Encodings via Local Curvature Profiles
Lukas Fesser, Melanie Weber
Abstract
Structural and Positional Encodings can significantly improve the performance of Graph Neural Networks in downstream tasks. Recent literature has begun to systematically investigate differences in the structural properties that these approaches encode, as well as performance trade-offs between them. However, the question of which structural properties yield the most effective encoding remains open. In this paper, we investigate this question from a geometric perspective. We propose a novel structural encoding based on discrete Ricci curvature (Local Curvature Profiles, short LCP ) and show that it significantly outperforms existing encoding approaches. We further show that combining local structural encodings, such as LCP, with global positional encodings improves downstream performance, suggesting that they capture complementary geometric information. Finally, we compare different encoding types with (curvature-based) rewiring techniques. Rewiring has recently received a surge of interest due to its ability to improve the performance of Graph Neural Networks by mitigating over-smoothing and over-squashing effects. Our results suggest that utilizing curvature information for structural encodings delivers significantly larger performance increases than rewiring. 1
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 55fd9a1a-7520-4404-a10b-0a2ebf8d63c3Cited by top-tier papers4
- Higher-Order Learning with Graph Neural Networks via Hypergraph EncodingsRaphaël Pellegrin, Lukas Fesser, Melanie WeberNeurIPS 2025 · 2 citations
- Balancing Efficiency and Expressiveness: Subgraph GNNs with Walk-Based CentralityJoshua Southern, Yam Eitan, Guy Bar-Shalom, Michael M. Bronstein et al.ICML 2025
- Recovering Manifold Structure Using Ollivier Ricci CurvatureTristan Luca Saidi, Abigail Hickok, Andrew J. BlumbergICLR 2025
- Unitary Convolutions for Message-passing and Positional Encodings on Directed GraphsLukas Fesser, Bobak Kiani, Melanie WeberICML 2026
Builds on12
- Recipe for a General, Powerful, Scalable Graph TransformerLadislav Rampásek, Michael Galkin, Vijay Prakash Dwivedi, Anh Tuan Luu et al.NeurIPS 2022 · 1,216 citations
- Rethinking Graph Transformers with Spectral AttentionDevin Kreuzer, Dominique Beaini, William L. Hamilton, Vincent Létourneau et al.NeurIPS 2021 · 854 citations
- Understanding over-squashing and bottlenecks on graphs via curvatureJake Topping, Francesco Di Giovanni, Benjamin Paul Chamberlain, Xiaowen Dong et al.ICLR 2022 · 628 citations
- Graph Neural Networks with Learnable Structural and Positional RepresentationsVijay Prakash Dwivedi, Anh Tuan Luu, Thomas Laurent, Yoshua Bengio et al.ICLR 2022 · 464 citations
- Distance Encoding: Design Provably More Powerful Neural Networks for Graph Representation LearningPan Li, Yanbang Wang, Hongwei Wang, Jure LeskovecNeurIPS 2020 · 391 citations
Related papers
- Curvature Graph NetworkZe Ye, Kin Sum Liu, Tengfei Ma, Jie Gao et al.ICLR 2020 · 81 citations
- Discrete Curvature Graph Information BottleneckXingcheng Fu, Jian Wang, Yisen Gao, Qingyun Sun et al.AAAI 2025 · 4 citations
- Revisiting Over-smoothing and Over-squashing Using Ollivier-Ricci CurvatureKhang Nguyen, Nong Minh Hieu, Vinh Duc Nguyen, Nhat Ho et al.ICML 2023 · 110 citations
- LEAP: Local ECT-Based Learnable Positional Encodings for GraphsJuan Amboage, Ernst Röell, Patrick Schnider, Bastian RieckICLR 2026 · 3 citations
- Rotary Position Encodings for GraphsIsaac Reid, Arijit Sehanobish, Cederik Höfs, Bruno Mlodozeniec et al.ICML 2026
