Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar Creation
Xiyi Chen, Marko Mihajlovic, Shaofei Wang, Sergey Prokudin, Siyu Tang
Abstract
4 https://xiyichen.github.io/morphablediffusion/ Figure 1. Morphable diffusion. We introduce a morphable diffusion model to enable consistent controllable novel view synthesis of humans from a single image. Given a single input image (a) and a morphable mesh model with a target facial expression (b) our method directly generates 3D consistent and photo-realistic images from novel viewpoints (c). Using the generated multi-view consistent images, we can reconstruct a coarse 3D model (d) using off-the-shelf neural surface reconstruction methods such as [80].
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4c2c908d-f314-4ab8-a680-e93878dc847bCited by top-tier papers9
- CGS-GAN: 3D Consistent Gaussian Splatting GANs for High Resolution Human Head SynthesisFlorian Barthel, Wieland Morgenstern, Paul Hinzer, Anna Hilsmann et al.NeurIPS 2025 · 8 citations
- FaceLift: Learning Generalizable Single Image 3D Face Reconstruction From Synthetic HeadsWeijie Lyu, Yi Zhou, Ming-Hsuan Yang, Zhixin ShuICCV 2025 · 5 citations
- SpinMeRound: Consistent Multi-View Identity Generation Using Diffusion ModelsStathis Galanakis, Alexandros Lattas, Stylianos Moschoglou, Bernhard Kainz et al.ICCV 2025 · 3 citations
- Fine-Grained 3D Gaussian Head Avatars Modeling from Static Captures Via Joint Reconstruction and RegistrationYuan Sun, Xuan Wang, Cong Wang, Weili Zhang et al.ICCV 2025 · 1 citation
- Anti-Avatar: Protect Against Unauthorized 3D Head Avatar Generation via Dual-Space DivergenceLingzhuang Meng, Mingwen Shao, Xiang Lv, Mengyao Wu et al.AAAI 2026 · 1 citation
Builds on61
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
Related papers
- Consistent View Synthesis with Pose-Guided Diffusion ModelsHung-Yu Tseng, Qinbo Li, Changil Kim, Suhib Alsisan et al.CVPR 2023
- MagicMan: Generative Novel View Synthesis of Humans with 3D-Aware Diffusion and Iterative RefinementXu He, Zhiyong Wu, Xiaoyu Li, Di Kang et al.AAAI 2025 · 11 citations
- MoRF: Morphable Radiance Fields for Multiview Neural Head ModelingDaoye Wang, Prashanth Chandran, Gaspard Zoss, Derek Bradley et al.SIGGRAPH 2022 · 54 citations
- PSHuman: Photorealistic Single-image 3D Human Reconstruction using Cross-Scale Multiview Diffusion and Explicit RemeshingPeng Li, Wangguandong Zheng, Yuan Liu, Tao Yu et al.CVPR 2025
- MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar ReconstructionZijian Dong, Longteng Duan, Jie Song, Michael J. Black et al.ICCV 2025 · 4 citations
