MonoNPHM: Dynamic Head Reconstruction from Monocular Videos
Simon Giebenhain, Tobias Kirschstein, Markos Georgopoulos, Martin Rünz, Lourdes Agapito, Matthias Nießner
Abstract
Figure 1 . We present MonoNPHM, a neural-field-based parametric head model (left), for dynamic 3D head reconstruction in monocular videos (right). On the left we demonstrate the effect on a reconstructed human head, by individually varying shape (top box), expression (middle box) and appearance (bottom box). The right-hand side illustrates three input RGB frames (top row), and our reconstructed geometry (bottom row). We also show the reconstructed appearance under estimated lighting conditions, which is the basis of our reconstruction.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5efcdf52-2143-4993-9b14-a4e8379ae878Cited by top-tier papers17
- Pixel3DMM: Versatile Screen-Space Priors for Single-Image 3D Face ReconstructionSimon Giebenhain, Tobias Kirschstein, Martin Rünz, Lourdes Agapito et al.ICLR 2026 · 24 citations
- DPHMs: Diffusion Parametric Head Models for Depth-Based TrackingJiapeng Tang, Angela Dai, Yinyu Nie, Lev Markhasin et al.CVPR 2024 · 6 citations
- ImHead: A Large-Scale Implicit Morphable Model for Localized Head ModelingRolandos Alexandros Potamias, Stathis Galanakis, Jiankang Deng, Athanasios Papaioannou et al.ICCV 2025 · 2 citations
- StreamME: Simplify 3D Gaussian Avatar within Live StreamLuchuan Song, Yang Zhou, Zhan Xu, Yi Zhou et al.SIGGRAPH 2025 · 2 citations
- SEREP: Semantic Facial Expression Representation for Robust in-the-Wild Capture and RetargetingArthur Josi, Luiz Gustavo Hafemann, Abdallah Dib, Emeline Got et al.ICCV 2025 · 1 citation
Builds on49
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt et al.NeurIPS 2021 · 2,500 citations
- Nerfies: Deformable Neural Radiance FieldsKeunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz et al.ICCV 2021 · 1,442 citations
Related papers
- Instant Volumetric Head AvatarsWojciech Zielonka, Timo Bolkart, Justus ThiesCVPR 2023
- Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB VideosZiqian Bai, Feitong Tan, Zeng Huang, Kripasindhu Sarkar et al.CVPR 2023
- Neural Head Avatars from Monocular RGB VideosPhilip-William Grassal, Malte Prinzler, Titus Leistner, Carsten Rother et al.CVPR 2022 · 173 citations
- Implicit Neural Head Synthesis via Controllable Local Deformation FieldsChuhan Chen, Matthew O'Toole, Gaurav Bharaj, Pablo GarridoCVPR 2023
- Monocular Reconstruction of Neural Face Reflectance FieldsMallikarjun B. R., Ayush Tewari, Tae-Hyun Oh, Tim Weyrich et al.CVPR 2021
