Learning Neural Parametric Head Models
Simon Giebenhain, Tobias Kirschstein, Markos Georgopoulos, Martin Rünz, Lourdes Agapito, Matthias Nießner
Abstract
Figure 1 . We propose to learn a neural parametric head model based on neural fields: first, we capture a large dataset of over 5200 highfidelity head scans with varying shapes and expressions (left). We then non-rigidly register these scans to generate our training data. As a result of training, we obtain a disentangled latent that spans the space of shapes z id and expressions z ex (middle). At inference time, we can leverage the prior of our learned representation by fitting our model to a sparse input point cloud by solving for the latent codes (right).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7c07054c-3b37-4bdc-9a61-cb591171eb04Cited by top-tier papers46
- NeRSemble: Multi-view Radiance Field Reconstruction of Human HeadsTobias Kirschstein, Shenhan Qian, Simon Giebenhain, Tim Walter et al.SIGGRAPH 2023 · 106 citations
- Neural Haircut: Prior-Guided Strand-Based Hair ReconstructionVanessa Sklyarova, Jenya Chelishev, Andreea Dogaru, Igor Medvedev et al.ICCV 2023 · 57 citations
- Media2Face: Co-speech Facial Animation Generation With Multi-Modality GuidanceQingcheng Zhao, Pengyu Long, Qixuan Zhang, Dafei Qin et al.SIGGRAPH 2024 · 40 citations
- Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face ReconstructionSimon Giebenhain, Tobias Kirschstein, Martin Rünz, Lourdes Agapito et al.ICLR 2026 · 24 citations
- Single-Shot Implicit Morphable Faces with Consistent Texture ParameterizationConnor Z. Lin, Koki Nagano, Jan Kautz, Eric R. Chan et al.SIGGRAPH 2023 · 14 citations
Builds on16
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- Nerfies: Deformable Neural Radiance FieldsKeunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz et al.ICCV 2021 · 1,442 citations
- Implicit Geometric Regularization for Learning ShapesAmos Gropp, Lior Yariv, Niv Haim, Matan Atzmon et al.ICML 2020 · 1,001 citations
- SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit ShapesXu Chen, Yufeng Zheng, Michael J. Black, Otmar Hilliges et al.ICCV 2021 · 267 citations
- Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and GenerationGiorgos Bouritsas, Sergiy Bokhnyak, Stylianos Ploumpis, Stefanos Zafeiriou et al.ICCV 2019 · 187 citations
Related papers
- Gaussian Head Avatar: Ultra High-Fidelity Head Avatar via Dynamic GaussiansYuelang Xu, Bengwang Chen, Zhe Li, Hongwen Zhang et al.CVPR 2024 · 84 citations
- i3DMM: Deep Implicit 3D Morphable Model of Human HeadsTarun Yenamandra, Ayush Tewari, Florian Bernard, Hans-Peter Seidel et al.CVPR 2021
- MonoNPHM: Dynamic Head Reconstruction from Monocular VideosSimon Giebenhain, Tobias Kirschstein, Markos Georgopoulos, Martin Rünz et al.CVPR 2024
- Learning Smooth Neural Functions via Lipschitz RegularizationHsueh-Ti Derek Liu, Francis Williams, Alec Jacobson, Sanja Fidler et al.SIGGRAPH 2022 · 63 citations
- 3DILG: Irregular Latent Grids for 3D Generative ModelingBiao Zhang, Matthias Nießner, Peter WonkaNeurIPS 2022 · 118 citations
