Complete Structure Guided Point Cloud Completion via Cluster- and Instance-Level Contrastive Learning
Yang Chen, Yirun Zhou, Weizhong Zhang, Cheng Jin
Abstract
Point cloud completion, aiming to reconstruct missing part from incomplete point clouds, is a pivotal task in 3D computer vision. Traditional supervised approaches often necessitate complete point clouds for training supervision, which are not readily accessible in real-world applications. Recent studies have attempted to mitigate this dependency by employing self-supervise mechanisms. However, these approaches frequently yield suboptimal results due to the absence of complete structure in the point cloud data during training. To address these issues, in this paper, we propose an effective framework to complete the point cloud under the guidance of self learned complete structure. A key contribution of our work is the development of a novel self-supervised complete structure reconstruction module, which can learn the complete structure explicitly from incomplete point clouds and thus eliminate the reliance on training data from complete point clouds. Additionally, we introduce a contrastive learning approach at both the cluster-and instance-level to extract shape features guided by the complete structure and to capture style features, respectively. This dual-level learning design ensures that the generated point clouds are both shape-completed and detail-preserving. Extensive experiments on both synthetic and real-world datasets demonstrate that our approach significantly outperforms state-of-the-art self-supervised methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on13
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal et al.NeurIPS 2020 · 5,249 citations
- SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-TransformerPeng Xiang, Xin Wen, Yu-Shen Liu, Yan-Pei Cao et al.ICCV 2021 · 318 citations
- Unpaired Point Cloud Completion on Real Scans using Adversarial TrainingXuelin Chen, Baoquan Chen, Niloy J. MitraICLR 2020 · 146 citations
Related papers
- Denoise and Contrast for Category Agnostic Shape CompletionAntonio Alliegro, Diego Valsesia, Giulia Fracastoro, Enrico Magli et al.CVPR 2021
- ACL-SPC: Adaptive Closed-Loop System for Self-Supervised Point Cloud CompletionSangmin Hong, Mohsen Yavartanoo, Reyhaneh Neshatavar, Kyoung Mu LeeCVPR 2023
- Learning a Structured Latent Space for Unsupervised Point Cloud CompletionYingjie Cai, Kwan-Yee Lin, Chao Zhang, Qiang Wang et al.CVPR 2022 · 46 citations
- P2C: Self-Supervised Point Cloud Completion from Single Partial CloudsRuikai Cui, Shi Qiu, Saeed Anwar, Jiawei Liu et al.ICCV 2023 · 40 citations
- Learning Point Cloud Completion without Complete Point Clouds: A Pose-Aware ApproachJihun Kim, Hyeokjun Kwon, Yunseo Yang, Kuk-Jin YoonICCV 2023 · 6 citations
