FitMe: Deep Photorealistic 3D Morphable Model Avatars
Alexandros Lattas, Stylianos Moschoglou, Stylianos Ploumpis, Baris Gecer, Jiankang Deng, Stefanos Zafeiriou
Abstract
S i n g l e i n -t h e -wi l d f a c i a l i ma g e S h a p e a n d Re f l e c t a n c e F i t t i n g S h a p e a n d Re f l e c t a n c e F i t t i n g A c q u i r e d F a c i a l Re f l e c t a n c e P h o t o r e a l i s t i c Re n d e r i n g P h o t o r e a l i s t i c Re n d e r i n g S h a p e Re n d e r i n g Figure 1. FitMe reconstructs relightable shape and reflectance maps for facial avatars, from a single (left) or multiple (right) unconstrained facial images, using a reflectance model and differentiable rendering. The results can be photorealistically rendered in common engines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 55763ee3-26ad-4669-978f-ec8b0a1cc41fCited by top-tier papers27
- Relightify: Relightable 3D Faces from a Single Image via Diffusion ModelsFoivos Paraperas Papantoniou, Alexandros Lattas, Stylianos Moschoglou, Stefanos ZafeiriouICCV 2023 · 40 citations
- 3D Facial Expressions through Analysis-by-Neural-SynthesisGeorge Retsinas, Panagiotis Paraskevas Filntisis, Radek Danecek, Victoria Fernández Abrevaya et al.CVPR 2024 · 26 citations
- VOODOO 3D: Volumetric Portrait Disentanglement for One-Shot 3D Head ReenactmentPhong Tran, Egor Zakharov, Long-Nhat Ho, Anh Tuan Tran et al.CVPR 2024 · 15 citations
- UltrAvatar: A Realistic Animatable 3D Avatar Diffusion Model with Authenticity Guided TexturesMingyuan Zhou, Rakib Hyder, Ziwei Xuan, Guojun QiCVPR 2024 · 8 citations
- Make-It-Vivid: Dressing Your Animatable Biped Cartoon Characters from TextJunshu Tang, Yanhong Zeng, Ke Fan, Xuheng Wang et al.CVPR 2024 · 6 citations
Builds on18
- Training Generative Adversarial Networks with Limited DataTero Karras, Miika Aittala, Janne Hellsten, Samuli Laine et al.NeurIPS 2020 · 2,345 citations
- Alias-Free Generative Adversarial NetworksTero Karras, Miika Aittala, Samuli Laine, Erik Härkönen et al.NeurIPS 2021 · 2,126 citations
- Soft Rasterizer: A Differentiable Renderer for Image-Based 3D ReasoningShichen Liu, Weikai Chen, Tianye Li, Hao LiICCV 2019 · 789 citations
- Authentic volumetric avatars from a phone scanChen Cao, Tomas Simon, Jin Kyu Kim, Gabe Schwartz et al.SIGGRAPH 2022 · 123 citations
- Photo-Realistic Facial Details Synthesis From Single ImageAnpei Chen, Zhang Chen, Guli Zhang, Kenny Mitchell et al.ICCV 2019 · 113 citations
Related papers
- High-Fidelity Face Tracking for AR/VR via Deep Lighting AdaptationLele Chen, Chen Cao, Fernando De la Torre, Jason M. Saragih et al.CVPR 2021
- AvatarMe: Realistically Renderable 3D Facial Reconstruction "In-the-Wild"Alexandros Lattas, Stylianos Moschoglou, Baris Gecer, Stylianos Ploumpis et al.CVPR 2020
- MoSAR: Monocular Semi-Supervised Model for Avatar Reconstruction using Differentiable ShadingAbdallah Dib, Luiz Gustavo Hafemann, Emeline Got, Trevor Anderson et al.CVPR 2024
- End-to-End 3D Face Reconstruction with Expressions and Specular Albedos from Single In-the-wild ImagesQixin Deng, Binh Huy Le, Aobo Jin, Zhigang DengACM MM 2022
- FLASHand: Feed-forward reLightable and Animatable Single-view Hand ReconstructionLing-Xiao Zhang, Lin Gao, Wei-Hong He, Yu-Xuan Yang et al.SIGGRAPH 2026
