VDW-GNNs: Vector diffusion wavelets for geometric graph neural networks
David R Johnson, Alexander Sietsema, Rishabh Anand, Deanna Needell, Smita Krishnaswamy, Michael Perlmutter
Abstract
We introduce vector diffusion wavelets (VDWs), a novel family of wavelets inspired by the vector diffusion maps algorithm that was introduced to analyze data lying in the tangent bundle of a Riemannian manifold. We show that these wavelets may be effectively incorporated into a family of geometric graph neural networks, which we refer to as VDW-GNNs. We demonstrate that such networks are effective on synthetic point cloud data, as well as on real-world data derived from wind field and neural activity measurements. Theoretically, we prove that these new wavelets have desirable frame theoretic properties, similar to traditional diffusion wavelets. Additionally, we prove that these wavelets have useful symmetries with respect to rotations and translations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on8
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- E(n) Equivariant Graph Neural NetworksVictor Garcia Satorras, Emiel Hoogeboom, Max WellingICML 2021 · 1,432 citations
- PyTorch 2: Faster Machine Learning Through Dynamic Python Bytecode Transformation and Graph CompilationJason Ansel, Edward Z. Yang, Horace He, Natalia Gimelshein et al.ASPLOS 2024 · 693 citations
- On the Expressive Power of Geometric Graph Neural NetworksChaitanya K. Joshi, Cristian Bodnar, Simon V. Mathis, Taco Cohen et al.ICML 2023 · 125 citations
- Can Hybrid Geometric Scattering Networks Help Solve the Maximum Clique Problem?Yimeng Min, Frederik Wenkel, Michael Perlmutter, Guy WolfNeurIPS 2022 · 30 citations
Related papers
- Directional Graph NetworksDominique Beaini, Saro Passaro, Vincent Létourneau, William L. Hamilton et al.ICML 2021 · 216 citations
- Implicit Gaussian process representation of vector fields over arbitrary latent manifoldsRobert L. Peach, Matteo Vinao-Carl, Nir Grossman, Michael David et al.ICLR 2024 · 8 citations
- Sheaf Neural Networks on SPD Manifolds: Second-Order Geometric Representation LearningYuhan Peng, Junwen Dong, Yuzhi Zeng, Hao Li et al.ICML 2026 · 1 citation
- An Intrinsic Vector Heat NetworkAlexander Gao, Maurice Chu, Mubbasir Kapadia, Ming C. Lin et al.ICML 2024 · 2 citations
- Manifold Diffusion FieldsAhmed A. A. Elhag, Yuyang Wang, Joshua M. Susskind, Miguel Ángel BautistaICLR 2024 · 11 citations
