TAGA: Self-supervised Learning for Template-free Animatable Gaussian Articulated Model
Zhichao Zhai, Guikun Chen, Wenguan Wang, Dong Zheng, Jun Xiao
Abstract
Decoupling from customized parametric templates represents a crucial step toward the creation of fully flexible, animatable articulated models. While existing template-free methods can achieve high-fidelity reconstruction in observed views, they struggle to recover plausible canonical models, resulting in suboptimal animation quality. This limitation stems from overlooking the fundamental ambiguity in canonical reconstruction, where multiple canonical models could explain the same observed views. By revealing the entanglement between the canonical ambiguity and incorrect skinning, we present a self-supervised framework that learns both plausible skinning and accurate canonical geometry using only sparse pose data. Our method, TAGA, uses explicit 3D Gaussians as skinning carriers and characterizes the ambiguity as "Ambiguous Gaussians" with incorrect skinning weights. TAGA then corrects ambiguous Gaussians in the observation space using anomaly detection. With the corrected ones, we enforce cycle consistency constraints on both geometry and skinning to refine the corresponding Gaussians in the canonical space through a new backward method. Compared to existing state-of-the-art template-free methods, TAGA delivers superior visual fidelity for novel views and poses, while significantly improving training and rendering speeds. Experiments on challenging datasets with limited pose variations further demonstrate the robustness and generality of TAGA.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e2ab54e3-10eb-43a2-9aba-cb1a4249ff8eCited by top-tier papers5
- Towards Human-Like Virtual Beings: Simulating Human Behavior in 3D ScenesChen Liang, Wenguan Wang, Yi YangICCV 2025 · 1 citation
- Dual Reciprocal Learning of Language-based Human Motion Understanding and GenerationChen Liang, Zhicheng Shi, Wenguan Wang, Yi YangICCV 2025 · 1 citation
- Secondary Motion-Aware 3D Clothed Gaussian Avatars from Monocular VideosSeungeun Lee, Seungjun Moon, Hah Min Lew, Ji-Su Kang et al.ICLR 2026
- SAMT: Generating Structured Avatar Meshes and Textures from a Single ImageMuyu Wang, Jianzhe Gao, Xingping Dong, Yujia Wang et al.ICML 2026
- Uncertainty-Aware 3D Reconstruction for Dynamic Underwater ScenesRui Liu, Zhibo Duan, Jianzhe Gao, Yi Yang et al.ICLR 2026
Builds on51
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- AI Choreographer: Music Conditioned 3D Dance Generation with AIST++Ruilong Li, Shan Yang, David A. Ross, Angjoo KanazawaICCV 2021 · 701 citations
- Animatable Neural Radiance Fields for Modeling Dynamic Human BodiesSida Peng, Junting Dong, Qianqian Wang, Shangzhan Zhang et al.ICCV 2021 · 461 citations
- HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular VideoChung-Yi Weng, Brian Curless, Pratul P. Srinivasan, Jonathan T. Barron et al.CVPR 2022 · 411 citations
- SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit ShapesXu Chen, Yufeng Zheng, Michael J. Black, Otmar Hilliges et al.ICCV 2021 · 267 citations
Related papers
- SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D ObservationCan Zhang, Gim Hee LeeCVPR 2026
- BANMo: Building Animatable 3D Neural Models from Many Casual VideosGengshan Yang, Minh Vo, Natalia Neverova, Deva Ramanan et al.CVPR 2022 · 113 citations
- GART: Gaussian Articulated Template ModelsJiahui Lei, Yufu Wang, Georgios Pavlakos, Lingjie Liu et al.CVPR 2024
- FastAnimate: Towards Learnable Template Construction and Pose Deformation for Fast 3D Human Avatar AnimationJian Shu, Nanjie Yao, Gangjian Zhang, Junlong Ren et al.AAAI 2026 · 1 citation
- SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar NetworksShunsuke Saito, Jinlong Yang, Qianli Ma, Michael J. BlackCVPR 2021
