SAMT: Generating Structured Avatar Meshes and Textures from a Single Image
Muyu Wang, Jianzhe Gao, Xingping Dong, Yujia Wang, Wenguan Wang
摘要
Despite rapid progress in generative 3D creation, producing high-fidelity 3D face assets from a single image remains challenging, as it requires both identity-critical facial micro-structures and fine-grained view-consistent textures. To address this, we present a two-stage framework named SAMT for monocular 3D avatar generation and texture synthesis. Specifically, a latent 3D diffusion model for facial mesh generation is pretrained and then further adapted to generate high-quality facial geometry through large-scale domain-specific finetuning on 35K curated 3D avatar models. Subsequently, the generated facial mesh is textured through a multi-view-aware texturing strategy. It incorporates multi-view facial priors along with the mesh geometry to guide a 2D texturing diffusion, enabling cross-view consistent and mesh-aligned texture synthesis. Extensive experiments demonstrate that SAMT improves over existing baselines by producing more coherent facial geometry together with more fine-grained and view-consistent textures. Project page is available at https://github.com/muyuWang/SAMT.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper41
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu 等ICLR 2022 · 被引用 18,833 次
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Scalable Diffusion Models with TransformersWilliam Peebles, Saining XieICCV 2023 · 被引用 5,568 次
相关 Paper
- High-Quality Full-Head 3D Avatar Generation from Any Single Portrait ImageYujie Gao, Chencheng Wang, Xianbing Sun, Jiahui Zhan 等AAAI 2026
- MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar ReconstructionZijian Dong, Longteng Duan, Jie Song, Michael J. Black 等ICCV 2025 · 被引用 4 次
- UV-IDM: Identity-Conditioned Latent Diffusion Model for Face UV-Texture GenerationHong Li, Yutang Feng, Song Xue, Xuhui Liu 等CVPR 2024
- Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion ModelsYuxuan Xue, Xianghui Xie, Riccardo Marin, Gerard Pons-MollNeurIPS 2024 · 被引用 49 次
- GAS: Generative Avatar Synthesis from a Single ImageYixing Lu, Junting Dong, Youngjoong Kwon, Qin Zhao 等ICCV 2025 · 被引用 5 次
