Learning Multiview 3D Point Cloud Registration
Zan Gojcic, Caifa Zhou, Jan D. Wegner, Leonidas J. Guibas, Tolga Birdal
Abstract
We present a novel, end-to-end learnable, multiview 3D point cloud registration algorithm. Registration of multiple scans typically follows a two-stage pipeline: the initial pairwise alignment and the globally consistent refinement. The former is often ambiguous due to the low overlap of neighboring point clouds, symmetries and repetitive scene parts. Therefore, the latter global refinement aims at establishing the cyclic consistency across multiple scans and helps in resolving the ambiguous cases. In this paper we propose, to the best of our knowledge, the first end-to-end algorithm for joint learning of both parts of this two-stage problem. Experimental evaluation on well accepted benchmark datasets shows that our approach outperforms the state-of-the-art by a significant margin, while being end-toend trainable and computationally less costly. Moreover, we present detailed analysis and an ablation study that validate the novel components of our approach. The source code and pretrained models are publicly available under https: //github.com/zgojcic/3D_multiview_reg .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d112f8ea-0bd3-41d7-a09f-425260772671Cited by top-tier papers39
- REGTR: End-to-end Point Cloud Correspondences with TransformersZi Jian Yew, Gim Hee LeeCVPR 2022 · 242 citations
- Graspness Discovery in Clutters for Fast and Accurate Grasp DetectionChenxi Wang, Haoshu Fang, Minghao Gou, Hongjie Fang et al.ICCV 2021 · 177 citations
- HRegNet: A Hierarchical Network for Large-scale Outdoor LiDAR Point Cloud RegistrationFan Lu, Guang Chen, Yinlong Liu, Lijun Zhang et al.ICCV 2021 · 133 citations
- Deep Hough Voting for Robust Global RegistrationJunha Lee, Seungwook Kim, Minsu Cho, Jaesik ParkICCV 2021 · 130 citations
- SiLK: Simple Learned KeypointsPierre Gleize, Weiyao Wang, Matt FeiszliICCV 2023 · 87 citations
Builds on5
- Deep Closest Point: Learning Representations for Point Cloud RegistrationYue Wang, Justin SolomonICCV 2019 · 1,026 citations
- Fully Convolutional Geometric FeaturesChristopher B. Choy, Jaesik Park, Vladlen KoltunICCV 2019 · 807 citations
- Learning Two-View Correspondences and Geometry Using Order-Aware NetworkJiahui Zhang, Dawei Sun, Zixin Luo, Anbang Yao et al.ICCV 2019 · 362 citations
- DeepVCP: An End-to-End Deep Neural Network for Point Cloud RegistrationWeixin Lu, Guowei Wan, Yao Zhou, Xiangyu Fu et al.ICCV 2019 · 313 citations
- Efficient and Robust Registration on the 3D Special Euclidean GroupUttaran Bhattacharya, Venu Madhav GovinduICCV 2019 · 21 citations
Related papers
- MultiBodySync: Multi-Body Segmentation and Motion Estimation via 3D Scan SynchronizationJiahui Huang, He Wang, Tolga Birdal, Minhyuk Sung et al.CVPR 2021
- End-to-End Learning Local Multi-View Descriptors for 3D Point CloudsLei Li, Siyu Zhu, Hongbo Fu, Ping Tan et al.CVPR 2020
- Rectified Point Flow: Generic Point Cloud Pose EstimationTao Sun, Liyuan Zhu, Shengyu Huang, Shuran Song et al.NeurIPS 2025 · 14 citations
- Global-Aware Registration of Less-Overlap RGB-D ScansChe Sun, Yunde Jia, Yi Guo, Yuwei WuCVPR 2022 · 3 citations
- Multiway Point Cloud Mosaicking with Diffusion and Global OptimizationShengze Jin, Iro Armeni, Marc Pollefeys, Dániel BaráthCVPR 2024
