FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervision
Tobias Kirschstein, Simon Giebenhain, Matthias Nießner
摘要
We introduce FlexAvatar, a method for creating high-quality and complete 3D head avatars from a single image. A core challenge lies in the limited availability of multi-view data and the tendency of monocular training to yield incomplete 3D head reconstructions. We identify the root cause of this issue as the entanglement between driving signal and target viewpoint when learning from monocular videos. To address this, we propose a transformer-based 3D portrait animation model with learnable data source tokens, so-called bias sinks, which enables unified training across monocular and multi-view datasets. This design leverages the strengths of both data sources during inference: strong generalization from monocular data and full 3D completeness from multi-view supervision. Furthermore, our training procedure yields a smooth latent avatar space that facilitates identity interpolation and flexible fitting to an arbitrary number of input observations. In extensive evaluations on single-view, few-shot, and monocular avatar creation tasks, we verify the efficacy of FlexAvatar. Many existing methods struggle with view extrapolation while FlexAvatar generates complete 3D head avatars with realistic facial animations. Website: https://tobias-kirschstein.github.io/flexavatar/
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- UIKA: Fast Universal Head Avatar from Pose-Free ImagesZijian Wu, Boyao Zhou, Liangxiao Hu, Hongyu Liu 等CVPR 2026 · 被引用 6 次
- Learning a Delighting Prior for Facial Appearance Capture in the WildYuxuan Han, Xin Ming, Tianxiao Li, Zhuofan Shen 等SIGGRAPH 2026
它引用的顶会 Paper42
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Scaling Rectified Flow Transformers for High-Resolution Image SynthesisPatrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari 等ICML 2024 · 被引用 3,620 次
- Nerfies: Deformable Neural Radiance FieldsKeunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz 等ICCV 2021 · 被引用 1,442 次
- Perceiver: General Perception with Iterative AttentionAndrew Jaegle, Felix Gimeno, Andy Brock, Oriol Vinyals 等ICML 2021 · 被引用 1,399 次
- VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real TimeSicheng Xu, Guojun Chen, Yu-Xiao Guo, Jiaolong Yang 等NeurIPS 2024 · 被引用 253 次
相关 Paper
- FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed DeformationCheng Peng, Zhuo Su, Liao Wang, Chen Guo 等CVPR 2026 · 被引用 2 次
- Avat3r: Large Animatable Gaussian Reconstruction Model for High-Fidelity 3D Head AvatarsTobias Kirschstein, Javier Romero, Artem Sevastopolsky, Matthias Nießner 等ICCV 2025 · 被引用 10 次
- Generalizable One-shot 3D Neural Head AvatarXueting Li, Shalini De Mello, Sifei Liu, Koki Nagano 等NeurIPS 2023 · 被引用 12 次
- FATE: Full-head Gaussian Avatar with Textural Editing from Monocular VideoJiawei Zhang, Zijian Wu, Zhiyang Liang, Yicheng Gong 等CVPR 2025
- FHAvatar: Fast and High-Fidelity Reconstruction of Face-and-Hair Composable 3D Head Avatar from Few Casual CapturesYujie Sun, Zhuoqiang CAI, Chaoyue Niu, Jianchuan Chen 等CVPR 2026
