StylePeople: A Generative Model of Fullbody Human Avatars
Artur Grigorev, Karim Iskakov, Anastasia Ianina, Renat Bashirov, Ilya Zakharkin, Alexander Vakhitov, Victor Lempitsky
Abstract
We propose a new type of full-body human avatars, which combines parametric mesh-based body model with a neural texture. We show that with the help of neural textures, such avatars can successfully model clothing and hair, which usually poses a problem for mesh-based approaches. We also show how these avatars can be created from multiple frames of a video using backpropagation. We then propose a generative model for such avatars that can be trained from datasets of images and videos of people. The generative model allows us to sample random avatars as well as to create dressed avatars of people from one or few images. The code for the project is available at saic-violet.github.io/style-people.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f7bd7a19-9d66-4713-86ef-63753f429734Cited by top-tier papers30
- AvatarCLIP: zero-shot text-driven generation and animation of 3D avatarsFangzhou Hong, Mingyuan Zhang, Liang Pan, Zhongang Cai et al.SIGGRAPH 2022 · 213 citations
- Text2Human: text-driven controllable human image generationYuming Jiang, Shuai Yang, Haonan Qiu, Wayne Wu et al.SIGGRAPH 2022 · 140 citations
- AG3D: Learning to Generate 3D Avatars from 2D Image CollectionsZijian Dong, Xu Chen, Jinlong Yang, Michael J. Black et al.ICCV 2023 · 76 citations
- gDNA: Towards Generative Detailed Neural AvatarsXu Chen, Tianjian Jiang, Jie Song, Jinlong Yang et al.CVPR 2022 · 71 citations
- Point-Based Modeling of Human ClothingIlya Zakharkin, Kirill Mazur, Artur Grigorev, Victor LempitskyICCV 2021 · 53 citations
Builds on12
- PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human DigitizationShunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima et al.ICCV 2019 · 1,411 citations
- Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?Rameen Abdal, Yipeng Qin, Peter WonkaICCV 2019 · 1,195 citations
- Few-Shot Adversarial Learning of Realistic Neural Talking Head ModelsEgor Zakharov, Aliaksandra Shysheya, Egor Burkov, Victor S. LempitskyICCV 2019 · 687 citations
- Multi-Garment Net: Learning to Dress 3D People From ImagesBharat Lal Bhatnagar, Garvita Tiwari, Christian Theobalt, Gerard Pons-MollICCV 2019 · 447 citations
- Tex2Shape: Detailed Full Human Body Geometry From a Single ImageThiemo Alldieck, Gerard Pons-Moll, Christian Theobalt, Marcus A. MagnorICCV 2019 · 343 citations
Related papers
- DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human AvatarsDavid Svitov, Dmitrii Gudkov, Renat Bashirov, Victor LempitskyICCV 2023 · 37 citations
- Animatable Gaussians: Learning Pose-Dependent Gaussian Maps for High-Fidelity Human Avatar ModelingZhe Li, Zerong Zheng, Lizhen Wang, Yebin LiuCVPR 2024
- Learning Locally Editable Virtual HumansHsuan-I Ho, Lixin Xue, Jie Song, Otmar HilligesCVPR 2023
- DreamHuman: Animatable 3D Avatars from TextNikos Kolotouros, Thiemo Alldieck, Andrei Zanfir, Eduard Gabriel Bazavan et al.NeurIPS 2023 · 136 citations
- Real-time deep dynamic charactersMarc Habermann, Lingjie Liu, Weipeng Xu, Michael Zollhöfer et al.SIGGRAPH 2021 · 118 citations
