PartDiffuser: Part-wise 3D Mesh Generation via Discrete Diffusion
Yichen Yang, Hong Li, Haodong Zhu, Linin Yang, Guojun Lei, Sheng Xu, Baochang Zhang
Abstract
Existing autoregressive (AR) methods for generating artistdesigned meshes struggle to balance global structural consistency with high-fidelity local details, and are susceptible to error accumulation. To address this, we propose PartDiffuser, a novel semi-autoregressive diffusion framework for point-cloud-to-mesh generation. The method first performs semantic segmentation on the mesh and then operates in a "part-wise" manner: it employs autoregression between parts to ensure global topology, while utilizing a parallel discrete diffusion process within each semantic part to precisely reconstruct high-frequency geometric features. Part-Diffuser is based on the DiT architecture and introduces a part-aware cross-attention mechanism, using point clouds as hierarchical geometric conditioning to dynamically control the generation process, thereby effectively decoupling the global and local generation tasks. Experiments demonstrate that this method significantly outperforms state-ofthe-art (SOTA) models in generating 3D meshes with rich detail, exhibiting exceptional detail representation suitable for real-world applications.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on30
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
- Large Language Diffusion ModelsShen Nie, Fengqi Zhu, Zebin You, Xiaolu Zhang et al.NeurIPS 2025 · 949 citations
- Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel DecodingChengyue Wu, Hao Zhang, Shuchen Xue, Zhijian Liu et al.ICLR 2026 · 428 citations
Related papers
- PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion TransformersYuchen Lin, Chenguo Lin, Panwang Pan, Honglei Yan et al.NeurIPS 2025 · 89 citations
- BuildAnyPoint: 3D Building Structured Abstraction from Diverse Point CloudsTongyan Hua, Haoran Gong, Yuan Liu, Di Wang et al.CVPR 2026 · 1 citation
- Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry GuidanceChenliang Zhou, Fangcheng Zhong, Weihao Xia, Albert Miao et al.ICLR 2026
- PointNSP: Autoregressive 3D Point Cloud Generation with Next-Scale Level-of-Detail PredictionZiqiao Meng, Qichao Wang, Zhiyang Dou, Zixing Song et al.CVPR 2026 · 9 citations
- TreeMeshGPT: Artistic Mesh Generation with Autoregressive Tree SequencingStefan Lionar, Jiabin Liang, Gim Hee LeeCVPR 2025
