Rethinking Multimodal Point Cloud Completion: A Completion-by-Correction Perspective
Wang Luo, Di Wu, Hengyuan Na, Yinlin Zhu, Miao Hu, Guocong Quan
Abstract
Point cloud completion aims to reconstruct complete 3D shapes from partial observations, which is a challenging problem due to severe occlusions and missing geometry. Despite recent advances in multimodal techniques that leverage complementary RGB images to compensate for missing geometry, most methods still follow a Completion-by-Inpainting paradigm, synthesizing missing structures from fused latent features. We empirically show that this paradigm often results in structural inconsistencies and topological artifacts due to limited geometric and semantic constraints. To address this, we rethink the task and propose a more robust paradigm, termed Completion-by-Correction, which begins with a topologically complete shape prior generated by a pretrained image-to-3D model and performs feature-space correction to align it with the partial observation. This paradigm shifts completion from unconstrained synthesis to guided refinement, enabling structurally consistent and observation-aligned reconstruction. Building upon this paradigm, we introduce PGNet, a multi-stage framework that conducts dual-feature encoding to ground the generative prior, synthesizes a coarse yet structurally aligned scaffold, and progressively refines geometric details via hierarchical correction. Experiments on the ShapeNetViPC dataset demonstrate the superiority of PGNet over state-of-the-art baselines in terms of average Chamfer Distance (-23.5%) and F-score (+7.1%).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 481d5d50-7211-4b05-a7be-b372221304c6Builds on19
- PoinTr: Diverse Point Cloud Completion with Geometry-Aware TransformersXumin Yu, Yongming Rao, Ziyi Wang, Zuyan Liu et al.ICCV 2021 · 592 citations
- SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-TransformerPeng Xiang, Xin Wen, Yu-Shen Liu, Yan-Pei Cao et al.ICCV 2021 · 318 citations
- PointAttN: You Only Need Attention for Point Cloud CompletionJun Wang, Ying Cui, Dongyan Guo, Junxia Li et al.AAAI 2024 · 113 citations
- Cross-modal Learning for Image-Guided Point Cloud Shape CompletionEmanuele Aiello, Diego Valsesia, Enrico MagliNeurIPS 2022 · 82 citations
- Point Cloud Completion with Pretrained Text-to-Image Diffusion ModelsYoni Kasten, Ohad Rahamim, Gal ChechikNeurIPS 2023 · 60 citations
Related papers
- CDPNet: Cross-Modal Dual Phases Network for Point Cloud CompletionZhenjiang Du, Jiale Dou, Zhitao Liu, Jiwei Wei et al.AAAI 2024 · 17 citations
- Geometric Alignment and Prior Modulation for View-Guided Point Cloud Completion on Unseen CategoriesJingqiao Xiu, Yicong Li, Na Zhao, Han Fang et al.ICCV 2025 · 2 citations
- LAKe-Net: Topology-Aware Point Cloud Completion by Localizing Aligned KeypointsJunshu Tang, Zhijun Gong, Ran Yi, Yuan Xie et al.CVPR 2022 · 74 citations
- Learning a Structured Latent Space for Unsupervised Point Cloud CompletionYingjie Cai, Kwan-Yee Lin, Chao Zhang, Qiang Wang et al.CVPR 2022 · 46 citations
- View-Guided Point Cloud CompletionXuancheng Zhang, Yutong Feng, Siqi Li, Changqing Zou et al.CVPR 2021
