SAMT: Generating Structured Avatar Meshes and Textures from a Single Image
Muyu Wang, Jianzhe Gao, Xingping Dong, Yujia Wang, Wenguan Wang
Abstract
Despite rapid progress in generative 3D creation, producing high-fidelity 3D face assets from a single image remains challenging, as it requires both identity-critical facial micro-structures and fine-grained view-consistent textures. To address this, we present a two-stage framework named SAMT for monocular 3D avatar generation and texture synthesis. Specifically, a latent 3D diffusion model for facial mesh generation is pretrained and then further adapted to generate high-quality facial geometry through large-scale domain-specific finetuning on 35K curated 3D avatar models. Subsequently, the generated facial mesh is textured through a multi-view-aware texturing strategy. It incorporates multi-view facial priors along with the mesh geometry to guide a 2D texturing diffusion, enabling cross-view consistent and mesh-aligned texture synthesis. Extensive experiments demonstrate that SAMT improves over existing baselines by producing more coherent facial geometry together with more fine-grained and view-consistent textures. Project page is available at https://github.com/muyuWang/SAMT.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b22fc151-e368-4f93-903f-50da72da9e47Builds on41
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 5,568 citations
Related papers
- High-Quality Full-Head 3D Avatar Generation from Any Single Portrait ImageYujie Gao, Chencheng Wang, Xianbing Sun, Jiahui Zhan et al.AAAI 2026
- MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar ReconstructionZijian Dong, Longteng Duan, Jie Song, Michael J. Black et al.ICCV 2025 · 4 citations
- UV-IDM: Identity-Conditioned Latent Diffusion Model for Face UV-Texture GenerationHong Li, Yutang Feng, Song Xue, Xuhui Liu et al.CVPR 2024
- Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion ModelsYuxuan Xue, Xianghui Xie, Riccardo Marin, Gerard Pons-MollNeurIPS 2024 · 49 citations
- GAS: Generative Avatar Synthesis from a Single ImageYixing Lu, Junting Dong, Youngjoong Kwon, Qin Zhao et al.ICCV 2025 · 5 citations
