Reverse2Complete: Unpaired Multimodal Point Cloud Completion via Guided Diffusion
Wenxiao Zhang, Hossein Rahmani, Xun Yang, Jun Liu
Abstract
Unpaired point cloud completion involves filling in missing parts of a point cloud without requiring partial-complete correspondence. Meanwhile, since point cloud completion is an ill-posed problem, there are multiple ways to generate the missing parts. Existing unpaired completion methods usually leverage generative adversarial training by transforming partial shape encoding into a complete one in the low-dimensional latent feature space. However, "mode collapse" often occurs, where only a subset of the shapes is represented in the low-dimensional space, reducing the diversity of the generated shapes. In this paper, we propose a novel unpaired multimodal shape completion approach that directly operates on point coordinate space. We achieve unpaired completion via a single diffusion model trained on complete data by "hijacking" the generative process. We further augment the diffusion model by introducing two guidance mechanisms to facilitate mapping the partial point cloud to the complete one while preserving its original structure. We conduct extensive evaluations of our approach, which show that our method generates shapes that are more diverse and better preserve the original structures compared to alternative methods.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 9ab19254-e4ad-4d41-bd82-f676b05c34ebCited by top-tier papers1
Ask how each one uses itRelated papers
- Learning a Structured Latent Space for Unsupervised Point Cloud CompletionYingjie Cai, Kwan-Yee Lin, Chao Zhang, Qiang Wang et al.CVPR 2022 · 46 citations
- Diverse Shape Completion via Style Modulated Generative Adversarial NetworksWesley Khademi, Fuxin LiNeurIPS 2023 · 2 citations
- 3D Shape Generation and Completion through Point-Voxel DiffusionLinqi Zhou, Yilun Du, Jiajun WuICCV 2021 · 681 citations
- CDPNet: Cross-Modal Dual Phases Network for Point Cloud CompletionZhenjiang Du, Jiale Dou, Zhitao Liu, Jiwei Wei et al.AAAI 2024 · 17 citations
- Cycle4Completion: Unpaired Point Cloud Completion Using Cycle Transformation With Missing Region CodingXin Wen, Zhizhong Han, Yan-Pei Cao, Pengfei Wan et al.CVPR 2021
