Learning a 3D Morphable Face Reflectance Model from Low-Cost Data
Yuxuan Han, Zhibo Wang, Feng Xu
Abstract
Morphable Face Reflectance Model Diffuse Albedo Linear Combination Weights for Different Specular Exponents Figure 1. We propose the first 3D morphable face reflectance model with spatially varying BRDF and a technique to train the model with low-cost publicly-available data. We represent face reflectance as a Lambertian BRDF combined with the linear combination of Blinn-Phong BRDFs with different predefined specular exponents. The reflectance parameters for each face vertex are the diffuse albedo and a set of weights. We show the first 3 principal components of diffuse albedo and spatially varying weights here in nonlinear sRGB space.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers12
- Neural Gaffer: Relighting Any Object via DiffusionHaian Jin, Yuan Li, Fujun Luan, Yuanbo Xiangli et al.NeurIPS 2024 · 112 citations
- DiLightNet: Fine-grained Lighting Control for Diffusion-based Image GenerationChong Zeng, Yue Dong, Pieter Peers, Youkang Kong et al.SIGGRAPH 2024 · 41 citations
- Monocular Identity-Conditioned Facial Reflectance ReconstructionXingyu Ren, Jiankang Deng, Yuhao Cheng, Jia Guo et al.CVPR 2024 · 4 citations
- Facial Appearance Capture at Home with Patch-Level Reflectance PriorYuxuan Han, Junfeng Lyu, Kuan Sheng, Minghao Que et al.SIGGRAPH 2025 · 2 citations
- VGGTFace: Topologically Consistent Facial Geometry Reconstruction in the WildXin Ming, Yuxuan Han, Tianyu Huang, Feng XuAAAI 2026 · 2 citations
Builds on17
- Learning an animatable detailed 3D face model from in-the-wild imagesYao Feng, Haiwen Feng, Michael J. Black, Timo BolkartSIGGRAPH 2021 · 662 citations
- I M Avatar: Implicit Morphable Head Avatars from VideosYufeng Zheng, Victoria Fernández Abrevaya, Marcel C. Bühler, Xu Chen et al.CVPR 2022 · 169 citations
- Total relighting: learning to relight portraits for background replacementRohit Pandey, Sergio Orts-Escolano, Chloe LeGendre, Christian Häne et al.SIGGRAPH 2021 · 138 citations
- Single-shot high-quality facial geometry and skin appearance captureJérémy Riviere, Paulo F. U. Gotardo, Derek Bradley, Abhijeet Ghosh et al.SIGGRAPH 2020 · 66 citations
- Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray TracingAbdallah Dib, Cédric Thébault, Junghyun Ahn, Philippe-Henri Gosselin et al.ICCV 2021 · 63 citations
Related papers
- A Morphable Face Albedo ModelWilliam A. P. Smith, Alassane Seck, Hannah M. Dee, Bernard Tiddeman et al.CVPR 2020
- Relightify: Relightable 3D Faces from a Single Image via Diffusion ModelsFoivos Paraperas Papantoniou, Alexandros Lattas, Stylianos Moschoglou, Stefanos ZafeiriouICCV 2023 · 40 citations
- Learning Complete 3D Morphable Face Models From Images and VideosMallikarjun B. R., Ayush Tewari, Hans-Peter Seidel, Mohamed A. Elgharib et al.CVPR 2021
- Monocular Reconstruction of Neural Face Reflectance FieldsMallikarjun B. R., Ayush Tewari, Tae-Hyun Oh, Tim Weyrich et al.CVPR 2021
- S^3-Face: SSS-Compliant Facial Reflectance Estimation via Diffusion PriorsXingyu Ren, Jiankang Deng, Yuhao Cheng, Wenhan Zhu et al.CVPR 2025
