TAGA: Self-supervised Learning for Template-free Animatable Gaussian Articulated Model
Zhichao Zhai, Guikun Chen, Wenguan Wang, Dong Zheng, Jun Xiao
摘要
Decoupling from customized parametric templates represents a crucial step toward the creation of fully flexible, animatable articulated models. While existing template-free methods can achieve high-fidelity reconstruction in observed views, they struggle to recover plausible canonical models, resulting in suboptimal animation quality. This limitation stems from overlooking the fundamental ambiguity in canonical reconstruction, where multiple canonical models could explain the same observed views. By revealing the entanglement between the canonical ambiguity and incorrect skinning, we present a self-supervised framework that learns both plausible skinning and accurate canonical geometry using only sparse pose data. Our method, TAGA, uses explicit 3D Gaussians as skinning carriers and characterizes the ambiguity as "Ambiguous Gaussians" with incorrect skinning weights. TAGA then corrects ambiguous Gaussians in the observation space using anomaly detection. With the corrected ones, we enforce cycle consistency constraints on both geometry and skinning to refine the corresponding Gaussians in the canonical space through a new backward method. Compared to existing state-of-the-art template-free methods, TAGA delivers superior visual fidelity for novel views and poses, while significantly improving training and rendering speeds. Experiments on challenging datasets with limited pose variations further demonstrate the robustness and generality of TAGA.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper5
- Towards Human-Like Virtual Beings: Simulating Human Behavior in 3D ScenesChen Liang, Wenguan Wang, Yi YangICCV 2025 · 被引用 1 次
- Dual Reciprocal Learning of Language-based Human Motion Understanding and GenerationChen Liang, Zhicheng Shi, Wenguan Wang, Yi YangICCV 2025 · 被引用 1 次
- Secondary Motion-Aware 3D Clothed Gaussian Avatars from Monocular VideosSeungeun Lee, Seungjun Moon, Hah Min Lew, Ji-Su Kang 等ICLR 2026
- SAMT: Generating Structured Avatar Meshes and Textures from a Single ImageMuyu Wang, Jianzhe Gao, Xingping Dong, Yujia Wang 等ICML 2026
- Uncertainty-Aware 3D Reconstruction for Dynamic Underwater ScenesRui Liu, Zhibo Duan, Jianzhe Gao, Yi Yang 等ICLR 2026
它引用的顶会 Paper51
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- AI Choreographer: Music Conditioned 3D Dance Generation with AIST++Ruilong Li, Shan Yang, David A. Ross, Angjoo KanazawaICCV 2021 · 被引用 701 次
- Animatable Neural Radiance Fields for Modeling Dynamic Human BodiesSida Peng, Junting Dong, Qianqian Wang, Shangzhan Zhang 等ICCV 2021 · 被引用 461 次
- HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular VideoChung-Yi Weng, Brian Curless, Pratul P. Srinivasan, Jonathan T. Barron 等CVPR 2022 · 被引用 411 次
- SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit ShapesXu Chen, Yufeng Zheng, Michael J. Black, Otmar Hilliges 等ICCV 2021 · 被引用 267 次
相关 Paper
- SCAPO: Self-Supervised Category-Level Articulated Pose Estimation from a Single 3D ObservationCan Zhang, Gim Hee LeeCVPR 2026
- BANMo: Building Animatable 3D Neural Models from Many Casual VideosGengshan Yang, Minh Vo, Natalia Neverova, Deva Ramanan 等CVPR 2022 · 被引用 113 次
- GART: Gaussian Articulated Template ModelsJiahui Lei, Yufu Wang, Georgios Pavlakos, Lingjie Liu 等CVPR 2024
- FastAnimate: Towards Learnable Template Construction and Pose Deformation for Fast 3D Human Avatar AnimationJian Shu, Nanjie Yao, Gangjian Zhang, Junlong Ren 等AAAI 2026 · 被引用 1 次
- SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar NetworksShunsuke Saito, Jinlong Yang, Qianli Ma, Michael J. BlackCVPR 2021
