On the Fourier analysis in the SO(3) space : the EquiLoPO Network
Dmitrii Zhemchuzhnikov, Sergei Grudinin
摘要
Analyzing volumetric data with rotational invariance or equivariance is currently an active research topic. Existing deep-learning approaches utilize either group convolutional networks limited to discrete rotations or steerable convolutional networks with constrained filter structures. This work proposes a novel equivariant neural network architecture that achieves analytical Equivariance to Local Pattern Orientation on the continuous SO(3) group while allowing unconstrained trainable filters -EquiLoPO Network. Our key innovations are a group convolutional operation leveraging irreducible representations as the Fourier basis and a local activation function in the SO(3) space that provides a well-defined mapping from input to output functions, preserving equivariance. By integrating these operations into a ResNet-style architecture, we propose a model that overcomes the limitations of prior methods. A comprehensive evaluation on diverse 3D medical imaging datasets from MedMNIST3D demonstrates the effectiveness of our approach, which consistently outperforms state of the art. This work suggests the benefits of true rotational equivariance on SO(3) and flexible unconstrained filters enabled by the local activation function, providing a flexible framework for equivariant deep learning on volumetric data with potential applications across domains. Our code is publicly available at https://gricad-gitlab.univ-grenoble-alpes.fr/GruLab/ ILPO/-/tree/main/EquiLoPO .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- Automatic Symmetry Discovery with Lie Algebra Convolutional NetworkNima Dehmamy, Robin Walters, Yanchen Liu, Dashun Wang 等NeurIPS 2021 · 被引用 120 次
- Equivariance with Learned Canonicalization FunctionsSékou-Oumar Kaba, Arnab Kumar Mondal, Yan Zhang, Yoshua Bengio 等ICML 2023 · 被引用 109 次
- Attentive Group Equivariant Convolutional NetworksDavid W. Romero, Erik J. Bekkers, Jakub M. Tomczak, Mark HoogendoornICML 2020 · 被引用 99 次
- Clifford Group Equivariant Neural NetworksDavid Ruhe, Johannes Brandstetter, Patrick ForréNeurIPS 2023 · 被引用 85 次
- Fast, Expressive SE(n) Equivariant Networks through Weight-Sharing in Position-Orientation SpaceErik J. Bekkers, Sharvaree P. Vadgama, Rob Hesselink, Putri A. van der Linden 等ICLR 2024 · 被引用 41 次
相关 Paper
- Vector Neurons: A General Framework for SO(3)-Equivariant NetworksCongyue Deng, Or Litany, Yueqi Duan, Adrien Poulenard 等ICCV 2021 · 被引用 411 次
- B-Spline CNNs on Lie groupsErik J. BekkersICLR 2020 · 被引用 155 次
- A Functional Approach to Rotation Equivariant Non-Linearities for Tensor Field NetworksAdrien Poulenard, Leonidas J. GuibasCVPR 2021
- Unsupervised Learning of Group Invariant and Equivariant RepresentationsRobin Winter, Marco Bertolini, Tuan Le, Frank Noé 等NeurIPS 2022 · 被引用 61 次
- PDO-s3DCNNs: Partial Differential Operator Based Steerable 3D CNNsZhengyang Shen, Tao Hong, Qi She, Jinwen Ma 等ICML 2022 · 被引用 8 次
