On the Fourier analysis in the SO(3) space : the EquiLoPO Network
Dmitrii Zhemchuzhnikov, Sergei Grudinin
Abstract
Analyzing volumetric data with rotational invariance or equivariance is currently an active research topic. Existing deep-learning approaches utilize either group convolutional networks limited to discrete rotations or steerable convolutional networks with constrained filter structures. This work proposes a novel equivariant neural network architecture that achieves analytical Equivariance to Local Pattern Orientation on the continuous SO(3) group while allowing unconstrained trainable filters -EquiLoPO Network. Our key innovations are a group convolutional operation leveraging irreducible representations as the Fourier basis and a local activation function in the SO(3) space that provides a well-defined mapping from input to output functions, preserving equivariance. By integrating these operations into a ResNet-style architecture, we propose a model that overcomes the limitations of prior methods. A comprehensive evaluation on diverse 3D medical imaging datasets from MedMNIST3D demonstrates the effectiveness of our approach, which consistently outperforms state of the art. This work suggests the benefits of true rotational equivariance on SO(3) and flexible unconstrained filters enabled by the local activation function, providing a flexible framework for equivariant deep learning on volumetric data with potential applications across domains. Our code is publicly available at https://gricad-gitlab.univ-grenoble-alpes.fr/GruLab/ ILPO/-/tree/main/EquiLoPO .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b37ca93f-a6d3-4fb4-8e44-26d0f78889bbBuilds on7
- Automatic Symmetry Discovery with Lie Algebra Convolutional NetworkNima Dehmamy, Robin Walters, Yanchen Liu, Dashun Wang et al.NeurIPS 2021 · 120 citations
- Equivariance with Learned Canonicalization FunctionsSékou-Oumar Kaba, Arnab Kumar Mondal, Yan Zhang, Yoshua Bengio et al.ICML 2023 · 109 citations
- Attentive Group Equivariant Convolutional NetworksDavid W. Romero, Erik J. Bekkers, Jakub M. Tomczak, Mark HoogendoornICML 2020 · 99 citations
- Clifford Group Equivariant Neural NetworksDavid Ruhe, Johannes Brandstetter, Patrick ForréNeurIPS 2023 · 85 citations
- Fast, Expressive SE(n) Equivariant Networks through Weight-Sharing in Position-Orientation SpaceErik J. Bekkers, Sharvaree P. Vadgama, Rob Hesselink, Putri A. van der Linden et al.ICLR 2024 · 41 citations
Related papers
- Vector Neurons: A General Framework for SO(3)-Equivariant NetworksCongyue Deng, Or Litany, Yueqi Duan, Adrien Poulenard et al.ICCV 2021 · 411 citations
- B-Spline CNNs on Lie groupsErik J. BekkersICLR 2020 · 155 citations
- A Functional Approach to Rotation Equivariant Non-Linearities for Tensor Field NetworksAdrien Poulenard, Leonidas J. GuibasCVPR 2021
- Unsupervised Learning of Group Invariant and Equivariant RepresentationsRobin Winter, Marco Bertolini, Tuan Le, Frank Noé et al.NeurIPS 2022 · 61 citations
- PDO-s3DCNNs: Partial Differential Operator Based Steerable 3D CNNsZhengyang Shen, Tao Hong, Qi She, Jinwen Ma et al.ICML 2022 · 8 citations
