Möbius Convolutions for Spherical CNNs
Thomas W. Mitchel, Noam Aigerman, Vladimir G. Kim, Michael Kazhdan
Abstract
Möbius transformations play an important role in both geometry and spherical image processing – they are the group of conformal automorphisms of 2D surfaces and the spherical equivalent of homographies. Here we present a novel, Möbius-equivariant spherical convolution operator which we call Möbius convolution; with it, we develop the foundations for Möbius-equivariant spherical CNNs. Our approach is based on the following observation: to achieve equivariance, we only need to consider the lower-dimensional subgroup which transforms the positions of points as seen in the frames of their neighbors. To efficiently compute Möbius convolutions at scale we derive an approximation of the action of the transformations on spherical filters, allowing us to compute our convolutions in the spectral domain with the fast Spherical Harmonic Transform. The resulting framework is flexible and descriptive, and we demonstrate its utility by achieving promising results in both shape classification and image segmentation tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers9
- Scaling Spherical CNNsCarlos Esteves, Jean-Jacques E. Slotine, Ameesh MakadiaICML 2023 · 28 citations
- Multi-body SE(3) Equivariance for Unsupervised Rigid Segmentation and Motion EstimationJia-Xing Zhong, Ta Ying Cheng, Yuhang He, Kai Lu et al.NeurIPS 2023 · 9 citations
- OmniZoomer: Learning to Move and Zoom in on Sphere at High-ResolutionZidong Cao, Hao Ai, Yan-Pei Cao, Ying Shan et al.ICCV 2023 · 8 citations
- Neural Isometries: Taming Transformations for Equivariant MLThomas W. Mitchel, Michael J. Taylor, Vincent SitzmannNeurIPS 2024 · 7 citations
- Scalable and Equivariant Spherical CNNs by Discrete-Continuous (DISCO) ConvolutionsJeremy Ocampo, Matthew A. Price, Jason D. McEwenICLR 2023 · 5 citations
Builds on16
- Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous DataMarc Finzi, Samuel Stanton, Pavel Izmailov, Andrew Gordon WilsonICML 2020 · 372 citations
- A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix GroupsMarc Finzi, Max Welling, Andrew Gordon WilsonICML 2021 · 226 citations
- Scalars are universal: Equivariant machine learning, structured like classical physicsSoledad Villar, David W. Hogg, Kate Storey-Fisher, Weichi Yao et al.NeurIPS 2021 · 185 citations
- Scale-Equivariant Steerable NetworksIvan Sosnovik, Michal Szmaja, Arnold W. M. SmeuldersICLR 2020 · 169 citations
- Lorentz Group Equivariant Neural Network for Particle PhysicsAlexander Bogatskiy, Brandon M. Anderson, Jan T. Offermann, Marwah Roussi et al.ICML 2020 · 164 citations
Related papers
- PDO-eS2CNNs: Partial Differential Operator Based Equivariant Spherical CNNsZhengyang Shen, Tiancheng Shen, Zhouchen Lin, Jinwen MaAAAI 2021 · 26 citations
- Scattering Networks on the Sphere for Scalable and Rotationally Equivariant Spherical CNNsJason D. McEwen, Christopher G. R. Wallis, Augustine N. Mavor-ParkerICLR 2022 · 26 citations
- Equivariance versus Augmentation for Spherical ImagesJan E. Gerken, Oscar Carlsson, Hampus Linander, Fredrik Ohlsson et al.ICML 2022 · 28 citations
- Spin-Weighted Spherical CNNsCarlos Esteves, Ameesh Makadia, Kostas DaniilidisNeurIPS 2020 · 81 citations
- DeepSphere: a graph-based spherical CNNMichaël Defferrard, Martino Milani, Frédérick Gusset, Nathanaël PerraudinICLR 2020 · 100 citations
