Rethinking Multimodal Point Cloud Completion: A Completion-by-Correction Perspective
Wang Luo, Di Wu, Hengyuan Na, Yinlin Zhu, Miao Hu, Guocong Quan
摘要
Point cloud completion aims to reconstruct complete 3D shapes from partial observations, which is a challenging problem due to severe occlusions and missing geometry. Despite recent advances in multimodal techniques that leverage complementary RGB images to compensate for missing geometry, most methods still follow a Completion-by-Inpainting paradigm, synthesizing missing structures from fused latent features. We empirically show that this paradigm often results in structural inconsistencies and topological artifacts due to limited geometric and semantic constraints. To address this, we rethink the task and propose a more robust paradigm, termed Completion-by-Correction, which begins with a topologically complete shape prior generated by a pretrained image-to-3D model and performs feature-space correction to align it with the partial observation. This paradigm shifts completion from unconstrained synthesis to guided refinement, enabling structurally consistent and observation-aligned reconstruction. Building upon this paradigm, we introduce PGNet, a multi-stage framework that conducts dual-feature encoding to ground the generative prior, synthesizes a coarse yet structurally aligned scaffold, and progressively refines geometric details via hierarchical correction. Experiments on the ShapeNetViPC dataset demonstrate the superiority of PGNet over state-of-the-art baselines in terms of average Chamfer Distance (-23.5%) and F-score (+7.1%).
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper19
- PoinTr: Diverse Point Cloud Completion with Geometry-Aware TransformersXumin Yu, Yongming Rao, Ziyi Wang, Zuyan Liu 等ICCV 2021 · 被引用 592 次
- SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-TransformerPeng Xiang, Xin Wen, Yu-Shen Liu, Yan-Pei Cao 等ICCV 2021 · 被引用 318 次
- PointAttN: You Only Need Attention for Point Cloud CompletionJun Wang, Ying Cui, Dongyan Guo, Junxia Li 等AAAI 2024 · 被引用 113 次
- Cross-modal Learning for Image-Guided Point Cloud Shape CompletionEmanuele Aiello, Diego Valsesia, Enrico MagliNeurIPS 2022 · 被引用 82 次
- Point Cloud Completion with Pretrained Text-to-Image Diffusion ModelsYoni Kasten, Ohad Rahamim, Gal ChechikNeurIPS 2023 · 被引用 60 次
相关 Paper
- CDPNet: Cross-Modal Dual Phases Network for Point Cloud CompletionZhenjiang Du, Jiale Dou, Zhitao Liu, Jiwei Wei 等AAAI 2024 · 被引用 17 次
- Geometric Alignment and Prior Modulation for View-Guided Point Cloud Completion on Unseen CategoriesJingqiao Xiu, Yicong Li, Na Zhao, Han Fang 等ICCV 2025 · 被引用 2 次
- LAKe-Net: Topology-Aware Point Cloud Completion by Localizing Aligned KeypointsJunshu Tang, Zhijun Gong, Ran Yi, Yuan Xie 等CVPR 2022 · 被引用 74 次
- Learning a Structured Latent Space for Unsupervised Point Cloud CompletionYingjie Cai, Kwan-Yee Lin, Chao Zhang, Qiang Wang 等CVPR 2022 · 被引用 46 次
- View-Guided Point Cloud CompletionXuancheng Zhang, Yutong Feng, Siqi Li, Changqing Zou 等CVPR 2021
