Rig-Reconstruct-Render (R33D): Collaborative Representation for Editable and Skeleton-Drivable 3D Asset Generation
Yuxuan Xiong, Ye Chen, Yue Shi, Zhangli Hu, Bingbing Ni
Abstract
Current 3D generation methods struggle to balance quality, efficiency, and controllability. This work introduces a collaborative 3D representation framework that leverages a proxy mesh as an intermediate representation. On the one hand, the proxy mesh establishes structural associations with the skeleton, guiding the generation of skeleton bindings that better align with target shape characteristics. On the other hand, it enables adaptive Gaussian sampling in the shape space for efficient rendering. Through the multi-level dependencies and collaboration among skeleton, proxy mesh, and 2DGS, image gradients obtained from diffusion models via the SDS method can synchronously and differentiably update the parameters of Gaussians, mesh shapes, and skeletons. This enables efficient generation of high-quality, editable, and driveable assets (with skeleton binding) under user-specified instructions. The proposed framework demonstrates its efficiency, high fidelity, and precise binding results in 3D rigged asset generation tasks.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Related papers
- Coin3D: Controllable and Interactive 3D Assets Generation with Proxy-Guided ConditioningWenqi Dong, Bangbang Yang, Lin Ma, Xiao Liu et al.SIGGRAPH 2024 · 18 citations
- DRiVE: Diffusion-based Rigging Empowers Generation of Versatile and Expressive CharactersMingze Sun, Junhao Chen, Junting Dong, Yurun Chen et al.CVPR 2025
- Stroke3D: Lifting 2D strokes into rigged 3D model via latent diffusion modelsRuisi Zhao, Haoren Zheng, Zongxin Yang, Hehe Fan et al.ICLR 2026 · 2 citations
- SKDream: Controllable Multi-view and 3D Generation with Arbitrary SkeletonsYuanyou Xu, Zongxin Yang, Yi YangCVPR 2025
- MIDGArD: Modular Interpretable Diffusion over Graphs for Articulated DesignsQuentin Leboutet, Nina Wiedemann, Zhipeng Cai, Michael Paulitsch et al.NeurIPS 2024 · 2 citations
