Fine-Grained 3D Gaussian Head Avatars Modeling from Static Captures Via Joint Reconstruction and Registration
Yuan Sun, Xuan Wang, Cong Wang, Weili Zhang, Yanbo Fan, Yu Guo, Fei Wang
Abstract
duces plausible modeling results, while the prior-free one is used to more freely capture the fine-grained geometric and texture details in the input images. Additionally, we simultaneously solve the registration problem between the two 3D Gaussian sets. On the one hand, the registration results will provide binding information for the prior-free reconstruction to make it animatable. On the other hand, during optimization, the prior-based Gaussian can regularize the prior-free reconstruction to resist overfitting and perform well in novel expressions. Finally, we merge the parts of the prior-based reconstruction that are occluded in the input images with the prior-free reconstruction set and then apply appropriate post-processing strategies (such as teeth enhancement) to produce a complete head avatar. We evaluated our method on the public Nersemble dataset and our own in-the-wild data. The experiments demonstrate that, under the same experimental settings, our method significantly improves modeling quality and provides better support for detailed modeling at higher resolutions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0ab62a4a-3d18-46f1-a5c9-41507a78b9c1Builds on47
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- PIRenderer: Controllable Portrait Image Generation via Semantic Neural RenderingYurui Ren, Ge Li, Yuanqi Chen, Thomas H. Li et al.ICCV 2021 · 284 citations
- HeadNeRF: A Realtime NeRF-based Parametric Head ModelYang Hong, Bo Peng, Haiyao Xiao, Ligang Liu et al.CVPR 2022 · 189 citations
Related papers
- SVG-Head: Hybrid Surface-Volumetric Gaussians for High-Fidelity Head Reconstruction and Real-Time EditingHeyi Sun, Cong Wang, Tian-Xing Xu, Jingwei Huang et al.ICCV 2025 · 8 citations
- GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view DiffusionJiapeng Tang, Davide Davoli, Tobias Kirschstein, Liam Schoneveld et al.CVPR 2025
- HERA: Hybrid Explicit Representation for Ultra-Realistic Head AvatarsHongrui Cai, Yuting Xiao, Xuan Wang, Jiafei Li et al.CVPR 2025
- MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head EditingCong Wang, Di Kang, Heyi Sun, Shen-Han Qian et al.CVPR 2025
- InvertAvatar: Incremental GAN Inversion for Generalized Head AvatarsXiaochen Zhao, Jingxiang Sun, Lizhen Wang, Jinli Suo et al.SIGGRAPH 2024 · 10 citations
