Equivariant Point Network for 3D Point Cloud Analysis
Haiwei Chen, Shichen Liu, Weikai Chen, Hao Li, Randall W. Hill Jr.
Abstract
Features that are equivariant to a larger group of symmetries have been shown to be more discriminative and powerful in recent studies [4, 40, 5] . However, higher-order equivariant features often come with an exponentiallygrowing computational cost. Furthermore, it remains relatively less explored how rotation-equivariant features can be leveraged to tackle 3D shape alignment tasks. While many past approaches have been based on either nonequivariant or invariant descriptors to align 3D shapes, we argue that such tasks may benefit greatly from an equivariant framework. In this paper, we propose an effective and practical SE(3) (3D translation and rotation) equivariant network for point cloud analysis that addresses both problems. First, we present SE(3) separable point convolution, a novel framework that breaks down the 6D convolution into two separable convolutional operators alternatively performed in the 3D Euclidean and SO(3) spaces respectively. This significantly reduces the computational cost without compromising the performance. Second, we introduce an attention layer to effectively harness the expressiveness of the equivariant features. While jointly trained with the network, the attention layer implicitly derives the intrinsic local frame in the feature space and generates attention vectors that can be integrated with different alignment tasks. We evaluate our approach through extensive studies and visual interpretations. The empirical results demonstrate that our proposed model outperforms strong baselines in a variety of benchmarks. Code is available at https://github.com/nintendops/EPN PointCloud .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bfab5cb4-ef73-4b2a-821c-8f7f19561345Cited by top-tier papers50
- Frame Averaging for Invariant and Equivariant Network DesignOmri Puny, Matan Atzmon, Edward J. Smith, Ishan Misra et al.ICLR 2022 · 177 citations
- Transformation-Equivariant 3D Object Detection for Autonomous DrivingHai Wu, Chenglu Wen, Wei Li, Xin Li et al.AAAI 2023 · 158 citations
- Reducing SO(3) Convolutions to SO(2) for Efficient Equivariant GNNsSaro Passaro, C. Lawrence ZitnickICML 2023 · 157 citations
- You Only Hypothesize Once: Point Cloud Registration with Rotation-equivariant DescriptorsHaiping Wang, Yuan Liu, Zhen Dong, Wenping WangACM MM 2022 · 143 citations
- FAENet: Frame Averaging Equivariant GNN for Materials ModelingAlexandre Duval, Victor Schmidt, Alex Hernández-García, Santiago Miret et al.ICML 2023 · 93 citations
Builds on4
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui et al.ICCV 2019 · 3,193 citations
- Equivariant Multi-View NetworksCarlos Esteves, Yinshuang Xu, Christine Allen-Blanchette, Kostas DaniilidisICCV 2019 · 108 citations
- Learning an Effective Equivariant 3D Descriptor Without SupervisionRiccardo Spezialetti, Samuele Salti, Luigi Di StefanoICCV 2019 · 41 citations
- End-to-End Learning Local Multi-View Descriptors for 3D Point CloudsLei Li, Siyu Zhu, Hongbo Fu, Ping Tan et al.CVPR 2020
Related papers
- E2PN: Efficient SE(3)-Equivariant Point NetworkMinghan Zhu, Maani Ghaffari, William A. Clark, Huei PengCVPR 2023
- Learning Coordinate-based Convolutional Kernels for Continuous SE(3) Equivariant and Efficient Point Cloud AnalysisJaein Kim, Hee Bin Yoo, Dong-Sig Han, Byoung-Tak ZhangCVPR 2026
- Pointwise Rotation-Invariant Network with Adaptive Sampling and 3D Spherical Voxel ConvolutionYang You, Yujing Lou, Qi Liu, Yu-Wing Tai et al.AAAI 2020 · 73 citations
- DeTarNet: Decoupling Translation and Rotation by Siamese Network for Point Cloud RegistrationZhi Chen, Fan Yang, Wenbing TaoAAAI 2022 · 34 citations
- PaRot: Patch-Wise Rotation-Invariant Network via Feature Disentanglement and Pose RestorationDingxin Zhang, Jianhui Yu, Chaoyi Zhang, Weidong CaiAAAI 2023 · 17 citations
