Diffusion Probabilistic Models for 3D Point Cloud Generation
Shitong Luo, Wei Hu
Abstract
We present a probabilistic model for point cloud generation, which is fundamental for various 3D vision tasks such as shape completion, upsampling, synthesis and data augmentation. Inspired by the diffusion process in nonequilibrium thermodynamics, we view points in point clouds as particles in a thermodynamic system in contact with a heat bath, which diffuse from the original distribution to a noise distribution. Point cloud generation thus amounts to learning the reverse diffusion process that transforms the noise distribution to the distribution of a desired shape. Specifically, we propose to model the reverse diffusion process for point clouds as a Markov chain conditioned on certain shape latent. We derive the variational bound in closed form for training and provide implementations of the model. Experimental results demonstrate that our model achieves competitive performance in point cloud generation and auto-encoding. The code is available at https://github.com/luost26/diffusion- point-cloud.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 85d66d01-061a-4098-acb1-9087c50763a4Cited by top-tier papers365
- Diffusion Probabilistic FieldsPeiye Zhuang, Samira Abnar, Jiatao Gu, Alexander G. Schwing et al.ICLR 2023 · 3,587 citations
- ILVR: Conditioning Method for Denoising Diffusion Probabilistic ModelsJooyoung Choi, Sungwon Kim, Yonghyun Jeong, Youngjune Gwon et al.ICCV 2021 · 933 citations
- Score-based Generative Modeling in Latent SpaceArash Vahdat, Karsten Kreis, Jan KautzNeurIPS 2021 · 903 citations
- Pseudo Numerical Methods for Diffusion Models on ManifoldsLuping Liu, Yi Ren, Zhijie Lin, Zhou ZhaoICLR 2022 · 861 citations
- LION: Latent Point Diffusion Models for 3D Shape GenerationXiaohui Zeng, Arash Vahdat, Francis Williams, Zan Gojcic et al.NeurIPS 2022 · 752 citations
Builds on3
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- PointFlow: 3D Point Cloud Generation With Continuous Normalizing FlowsGuandao Yang, Xun Huang, Zekun Hao, Ming-Yu Liu et al.ICCV 2019 · 794 citations
- 3D Point Cloud Generative Adversarial Network Based on Tree Structured Graph ConvolutionsDong Wook Shu, Sung Woo Park, Junseok KwonICCV 2019 · 337 citations
Related papers
- 3D Shape Generation and Completion through Point-Voxel DiffusionLinqi Zhou, Yilun Du, Jiajun WuICCV 2021 · 681 citations
- 3DDM: Physically-based Anisotropic 3D Diffusion Model with 3D Gaussian for Point Cloud CompletionLong Xi, Jia Ma, ZhenYu Yuan, Tao Xue et al.AAAI 2026
- Sketch and Text Guided Diffusion Model for Colored Point Cloud GenerationZijie Wu, Yaonan Wang, Mingtao Feng, He Xie et al.ICCV 2023 · 55 citations
- Reverse2Complete: Unpaired Multimodal Point Cloud Completion via Guided DiffusionWenxiao Zhang, Hossein Rahmani, Xun Yang, Jun LiuACM MM 2024 · 4 citations
- Diffusion-SDF: Conditional Generative Modeling of Signed Distance FunctionsGene Chou, Yuval Bahat, Felix HeideICCV 2023 · 171 citations
