DRiVE: Diffusion-based Rigging Empowers Generation of Versatile and Expressive Characters
Mingze Sun, Junhao Chen, Junting Dong, Yurun Chen, Xinyu Jiang, Shiwei Mao, Puhua Jiang, Jingbo Wang, Bo Dai, Ruqi Huang
Abstract
Recent advances in generative models have enabled high-quality 3D character reconstruction from multi-modal. However, animating these generated characters remains a challenging task, especially for complex elements like garments and hair, due to the lack of large-scale datasets and effective rigging methods. To address this gap, we curate AnimeRig, a large-scale dataset with detailed skeleton and skinning annotations. Building upon this, we propose DRiVE, a novel framework for generating and rigging 3D human characters with intricate structures. Unlike existing methods, DRiVE utilizes a 3D Gaussian representation, facilitating efficient animation and high-quality rendering. We further introduce GSDiff, a 3D Gaussian-based diffusion module that predicts joint positions as spatial distributions, overcoming the limitations of regression-based approaches. Extensive experiments demonstrate that DRiVE achieves precise rigging results, enabling realistic dynamics for clothing and hair, and surpassing previous methods in both quality and versatility. Code, dataset and visualization results are available at https://DRiVEAvatar.github.io/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d2db73c2-f8b0-4be0-a453-7b434d41ee3cCited by top-tier papers13
- Puppeteer: Rig and Animate Your 3D ModelsChaoyue Song, Xiu Li, Fan Yang, Zhongcong Xu et al.NeurIPS 2025 · 48 citations
- HVG-3D: Bridging Real and Simulation Domains for 3D-Conditional Hand-Object Interaction Video SynthesisMingjin Chen, Junhao Chen, Zhaoxin Fan, Yujian Lee et al.CVPR 2026 · 13 citations
- Animator-Centric Skeleton Generation on Objects with Fine-Grained DetailsMingze Sun, Cheng Zeng, Jiansong Pei, Junhao Chen et al.CVPR 2026 · 10 citations
- LottieGPT: Tokenizing Vector Animation for Autoregressive GenerationJunhao Chen, Kejun Gao, Yuehan Cui, Mingze Sun et al.CVPR 2026 · 10 citations
- One Model to Rig Them All: Diverse Skeleton Rigging with UniRigJia-Peng Zhang, Cheng-Feng Pu, Meng-Hao Guo, Yan-Pei Cao et al.SIGGRAPH 2025 · 10 citations
Builds on39
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- SDXL: Improving Latent Diffusion Models for High-Resolution Image SynthesisDustin Podell, Zion English, Kyle Lacey, Andreas Blattmann et al.ICLR 2024 · 4,569 citations
Related papers
- ARMO: Autoregressive Rigging for Multi-Category ObjectsMingze Sun, Shiwei Mao, Keyi Chen, Yurun Chen et al.ICCV 2025 · 3 citations
- HumanRig: Learning Automatic Rigging for Humanoid Character in a Large Scale DatasetZedong Chu, Feng Xiong, Meiduo Liu, Jinzhi Zhang et al.CVPR 2025
- InterCoser: Interactive 3D Character Creation with Disentangled Fine-Grained FeaturesYi Wang, Jian Ma, Zhuo Su, Guidong Wang et al.AAAI 2026
- Anime-Ready: Controllable 3D Anime Character Generation with Body-Aligned Component-Wise Garment ModelingJiachen Qian, Hongye Yang, Youtian Lin, Tianhao Zhao et al.ICLR 2026
- Human Geometry Distribution for 3D Animation GenerationXiangjun Tang, Biao Zhang, Peter WonkaCVPR 2026 · 2 citations
