Unleashing Vecset Diffusion Model for Fast Shape Generation
Zeqiang Lai, Yunfei Zhao, Zibo Zhao, Haolin Liu, Fuyun Wang, Huiwen Shi, Xianghui Yang, Qingxiang Lin, Jingwei Huang, Yuhong Liu, Jie Jiang, Chunchao Guo, Xiangyu Yue
Abstract
3D shape generation has greatly flourished through the development of so-called "native" 3D diffusion, particularly through the Vecset Diffusion Model (VDM). While recent advancements have shown promising results in generating high-resolution 3D shapes, VDM still struggles with high-speed generation. Challenges exist because of difficulties not only in accelerating diffusion sampling but also VAE decoding in VDM, areas under-explored in previous works. To address these challenges, we present FlashVDM, a systematic framework for accelerating both VAE and DiT in VDM. For DiT, FlashVDM enables flexible diffusion sampling with as few as 5 inference steps and comparable quality, which is made possible by stabilizing consistency distillation with our newly introduced Progressive Flow Distillation. For VAE, we introduce a lightning vecset decoder equipped with Adaptive KV Selection, Hierarchical Volume Decoding, and Efficient Network Design. By exploiting the locality of the vecset and the sparsity of shape surface in the volume, our decoder drastically lowers FLOPs, minimizing the overall decoding overhead. We apply FlashVDM to Hunyuan3D-2 to obtain Hunyuan3D-2 Turbo. Through systematic evaluation, we show that our model significantly outperforms existing fast 3D generation methods, achieving comparable performance to the state-of-the-art while reducing inference time by over 45x for reconstruction and 32x for generation. Code and models are available at https://github.com/Tencent/FlashVDM.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 72b3eacd-db71-4da6-8c54-fa2fe756aeb7Cited by top-tier papers11
- Efficient Part-level 3D Object Generation via Dual Volume PackingJiaxiang Tang, Ruijie Lu, Max Li, Zekun Hao et al.NeurIPS 2025 · 53 citations
- LATTICE: Democratize High-Fidelity 3D Generation at ScaleZeqiang Lai, Yunfei Zhao, Zibo Zhao, Haolin Liu et al.CVPR 2026 · 46 citations
- NaTex: Seamless Texture Generation as Latent Color DiffusionZeqiang Lai, Yunfei Zhao, Zibo Zhao, Xin Yang et al.CVPR 2026 · 11 citations
- Elastic Diffusion TransformerJiangshan Wang, Zeqiang Lai, Jiarui Chen, Jiayi Guo et al.ICML 2026 · 7 citations
- Mesh-Pro: Asynchronous Advantage-guided Ranking Preference Optimization for Artist-style Quadrilateral Mesh GenerationZhen Zhou, Jian Liu, Biwen Lei, Jing Xu et al.CVPR 2026 · 2 citations
Builds on40
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, Steven C. H. HoiICML 2023 · 7,873 citations
- DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 StepsCheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen et al.NeurIPS 2022 · 2,653 citations
- Consistency ModelsYang Song, Prafulla Dhariwal, Mark Chen, Ilya SutskeverICML 2023 · 1,720 citations
Related papers
- Flash-VAED: Plug-and-Play VAE Decoders for Efficient Video GenerationLunjie Zhu, Yushi Huang, Xingtong Ge, Yufei Xue et al.ICML 2026
- FastLightGen: Fast and Light Video Generation with Fewer Steps and ParametersShitong Shao, Yufei Gu, Zeke XieCVPR 2026 · 4 citations
- Few-step Flow for 3D Generation via Marginal-Data Transport DistillationZanwei Zhou, Taoran Yi, Jiemin Fang, Chen Yang et al.AAAI 2026 · 1 citation
- FVGen: Accelerating Novel-View Synthesis with Adversarial Video Diffusion DistillationWenbin Teng, Gonglin Chen, Haiwei Chen, Yajie ZhaoICCV 2025
- From Sketch to Fresco: Efficient Diffusion Transformer with Progressive ResolutionShikang Zheng, Guantao Chen, Landis He, Jiacheng Liu et al.CVPR 2026 · 6 citations
