Diffusion-SDF: Text-to-Shape via Voxelized Diffusion
Muheng Li, Yueqi Duan, Jie Zhou, Jiwen Lu
Abstract
Text-to-Shape Generation Text-Guided Shape Completion Text-Guided Shape Manipulation A chair with straight legs. A chair with curving legs. Incomplete Shape A straight chair. A sofa. A ball-shaped revolving chair. A sofa with curving legs. A two-layered triangular table .
An artistic chair. Figure 1 . We propose a text-to-shape synthesis approach named Diffusion-SDF. Our method is capable of performing various text-to-shape tasks including text-to-shape generation (directly generating 3D shapes from texts), text-guided shape completion (generating the missing part of an incomplete shape under the guidance of texts), and text-guided shape manipulation (modifying a given shape according to texts).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f48fbb23-7348-44fb-9b1b-1b1596d4970fCited by top-tier papers63
- Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content CreationRui Chen, Yongwei Chen, Ningxin Jiao, Kui JiaICCV 2023 · 769 citations
- Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent RepresentationZibo Zhao, Wen Liu, Xin Chen, Xianfang Zeng et al.NeurIPS 2023 · 279 citations
- DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion PriorJingxiang Sun, Bo Zhang, Ruizhi Shao, Lizhen Wang et al.ICLR 2024 · 181 citations
- DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape GenerationShentong Mo, Enze Xie, Ruihang Chu, Lanqing Hong et al.NeurIPS 2023 · 157 citations
- Locally Attentional SDF Diffusion for Controllable 3D Shape GenerationXin-Yang Zheng, Hao Pan, Peng-Shuai Wang, Xin Tong et al.SIGGRAPH 2023 · 122 citations
Builds on27
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
Related papers
- Towards Implicit Text-Guided 3D Shape GenerationZhengzhe Liu, Yi Wang, Xiaojuan Qi, Chi-Wing FuCVPR 2022 · 59 citations
- HyperSDFusion: Bridging Hierarchical Structures in Language and Geometry for Enhanced 3D Text2Shape GenerationZhiying Leng, Tolga Birdal, Xiaohui Liang, Federico TombariCVPR 2024
- Point Cloud Completion with Pretrained Text-to-Image Diffusion ModelsYoni Kasten, Ohad Rahamim, Gal ChechikNeurIPS 2023 · 60 citations
- SDFusion: Multimodal 3D Shape Completion, Reconstruction, and GenerationYen-Chi Cheng, Hsin-Ying Lee, Sergey Tulyakov, Alexander G. Schwing et al.CVPR 2023
- TAPS3D: Text-Guided 3D Textured Shape Generation from Pseudo SupervisionJiacheng Wei, Hao Wang, Jiashi Feng, Guosheng Lin et al.CVPR 2023
