SwiftAvatar: Efficient Auto-Creation of Parameterized Stylized Character on Arbitrary Avatar Engines
Shizun Wang, Weihong Zeng, Xu Wang, Hao Yang, Li Chen, Chuang Zhang, Ming Wu, Yi Yuan, Yunzhao Zeng, Min Zheng, Jing Liu
摘要
The creation of a parameterized stylized character involves careful selection of numerous parameters, also known as the "avatar vectors" that can be interpreted by the avatar engine. Existing unsupervised avatar vector estimation methods that auto-create avatars for users, however, often fail to work because of the domain gap between realistic faces and stylized avatar images. To this end, we propose SwiftAvatar, a novel avatar auto-creation framework that is evidently superior to previous works. SwiftAvatar introduces dual-domain generators to create pairs of realistic faces and avatar images using shared latent codes. The latent codes can then be bridged with the avatar vectors as pairs, by performing GAN inversion on the avatar images rendered from the engine using avatar vectors. Through this way, we are able to synthesize paired data in high-quality as many as possible, consisting of avatar vectors and their corresponding realistic faces. We also propose semantic augmentation to improve the diversity of synthesis. Finally, a light-weight avatar vector estimator is trained on the synthetic pairs to implement efficient auto-creation. Our experiments demonstrate the effectiveness and efficiency of SwiftAvatar on two different avatar engines. The superiority and advantageous flexibility of SwiftAvatar are also verified in both subjective and objective evaluations.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper9
- Symmetric Cross Entropy for Robust Learning With Noisy LabelsYisen Wang, Xingjun Ma, Zaiyi Chen, Yuan Luo 等ICCV 2019 · 被引用 1,125 次
- SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and EditingYichun Shi, Xiao Yang, Yangyue Wan, Xiaohui ShenCVPR 2022 · 被引用 88 次
- AgileGAN: stylizing portraits by inversion-consistent transfer learningGuoxian Song, Linjie Luo, Jing Liu, Wan-Chun Ma 等SIGGRAPH 2021 · 被引用 80 次
- Face-to-Parameter Translation for Game Character Auto-CreationTianyang Shi, Yi Yuan, Changjie Fan, Zhengxia Zou 等ICCV 2019 · 被引用 56 次
- Fast and Robust Face-to-Parameter Translation for Game Character Auto-CreationTianyang Shi, Zhengxia Zou, Yi Yuan, Changjie FanAAAI 2020 · 被引用 38 次
相关 Paper
- HyperGaussians: High-Dimensional Gaussian Splatting for High-Fidelity Animatable Face AvatarsGent Serifi, Marcel C. BühlerCVPR 2026 · 被引用 4 次
- Cross-modal Latent Space Alignment for Image to Avatar TranslationManuel Ladron de Guevara, Yannick Hold-Geoffroy, Jose Echevarria, Cameron Smith 等ICCV 2023 · 被引用 5 次
- Generalizable and Animatable Gaussian Head AvatarXuangeng Chu, Tatsuya HaradaNeurIPS 2024 · 被引用 115 次
- InvertAvatar: Incremental GAN Inversion for Generalized Head AvatarsXiaochen Zhao, Jingxiang Sun, Lizhen Wang, Jinli Suo 等SIGGRAPH 2024 · 被引用 10 次
- Interpreting the Latent Space of GANs for Semantic Face EditingYujun Shen, Jinjin Gu, Xiaoou Tang, Bolei ZhouCVPR 2020
