Learning Coordinate-based Convolutional Kernels for Continuous SE(3) Equivariant and Efficient Point Cloud Analysis
Jaein Kim, Hee Bin Yoo, Dong-Sig Han, Byoung-Tak Zhang
Abstract
A symmetry on rigid motion is one of the salient factors in efficient learning of 3D point cloud problems. Group convolution has been a representative method to extract equivariant features, but its realizations have struggled to retain both rigorous symmetry and scalability simultaneously. We advocate utilizing the intertwiner framework to resolve this trade-off, but previous works on it, which did not achieve complete SE(3) symmetry or scalability to large-scale problems, necessitate a more advanced kernel architecture. We present Equivariant Coordinate-based Kernel Convolution, or ECKConv. It acquires SE(3) equivariance from the kernel domain defined in a double coset space, and its explicit kernel design using coordinate-based networks enhances its learning capability and memory efficiency. The experiments on diverse point cloud tasks, e.g., classification, pose registration, part segmentation, and large-scale semantic segmentation, validate the rigid equivariance, memory scalability, and outstanding performance of ECKConv compared to state-of-the-art equivariant methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on20
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui et al.ICCV 2019 · 3,193 citations
- Deep Closest Point: Learning Representations for Point Cloud RegistrationYue Wang, Justin SolomonICCV 2019 · 1,026 citations
- SE(3)-Transformers: 3D Roto-Translation Equivariant Attention NetworksFabian Fuchs, Daniel E. Worrall, Volker Fischer, Max WellingNeurIPS 2020 · 1,025 citations
- Point Transformer V2: Grouped Vector Attention and Partition-based PoolingXiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu et al.NeurIPS 2022 · 924 citations
- Vector Neurons: A General Framework for SO(3)-Equivariant NetworksCongyue Deng, Or Litany, Yueqi Duan, Adrien Poulenard et al.ICCV 2021 · 411 citations
Related papers
- E2PN: Efficient SE(3)-Equivariant Point NetworkMinghan Zhu, Maani Ghaffari, William A. Clark, Huei PengCVPR 2023
- Multi-body SE(3) Equivariance for Unsupervised Rigid Segmentation and Motion EstimationJia-Xing Zhong, Ta Ying Cheng, Yuhang He, Kai Lu et al.NeurIPS 2023 · 9 citations
- Equivariant Point Network for 3D Point Cloud AnalysisHaiwei Chen, Shichen Liu, Weikai Chen, Hao Li et al.CVPR 2021
- VV-Net: Voxel VAE Net With Group Convolutions for Point Cloud SegmentationHsien-Yu Meng, Lin Gao, Yu-Kun Lai, Dinesh ManochaICCV 2019 · 268 citations
- Fast, Expressive SE(n) Equivariant Networks through Weight-Sharing in Position-Orientation SpaceErik J. Bekkers, Sharvaree P. Vadgama, Rob Hesselink, Putri A. van der Linden et al.ICLR 2024 · 41 citations
