Animating Through Warping: An Efficient Method for High-Quality Facial Expression Animation
Zili Yi, Qiang Tang, Vishnu Sanjay Ramiya Srinivasan, Zhan Xu
Abstract
Advances in deep neural networks have considerably improved the art of animating a still image without operating in 3D domain. Whereas, prior arts can only animate small images (typically no larger than 512x512) due to memory limitations, difficulty of training and lack of high-resolution (HD) training datasets, which significantly reduce their potential for applications in movie production and interactive systems. Motivated by the idea that HD images can be generated by adding high-frequency residuals to low-resolution results produced by a neural network, we propose a novel framework known as Animating Through Warping (ATW) to enable efficient animation of HD images.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Versatile Face Animator: Driving Arbitrary 3D Facial Avatar in RGBD SpaceHaoyu Wang, Haozhe Wu, Junliang Xing, Jia JiaACM MM 2023 · 6 citations
- Structure-Aware Flow Generation for Human Body ReshapingJianqiang Ren, Yuan Yao, Biwen Lei, Miaomiao Cui et al.CVPR 2022 · 6 citations
- Pareidolia Face ReenactmentLinsen Song, Wayne Wu, Chaoyou Fu, Chen Qian et al.CVPR 2021
Builds on4
- FSGAN: Subject Agnostic Face Swapping and ReenactmentYuval Nirkin, Yosi Keller, Tal HassnerICCV 2019 · 710 citations
- Few-Shot Adversarial Learning of Realistic Neural Talking Head ModelsEgor Zakharov, Aliaksandra Shysheya, Egor Burkov, Victor S. LempitskyICCV 2019 · 687 citations
- FLNet: Landmark Driven Fetching and Learning Network for Faithful Talking Facial Animation SynthesisKuangxiao Gu, Yuqian Zhou, Thomas S. HuangAAAI 2020 · 63 citations
- Attribute-Driven Spontaneous Motion in Unpaired Image TranslationRuizheng Wu, Xin Tao, Xiaodong Gu, Xiaoyong Shen et al.ICCV 2019 · 18 citations
Related papers
- Leveraging Frequency Analysis for Deep Fake Image RecognitionJoel Frank, Thorsten Eisenhofer, Lea Schönherr, Asja Fischer et al.ICML 2020 · 848 citations
- SRWarp: Generalized Image Super-Resolution under Arbitrary TransformationSanghyun Son, Kyoung Mu LeeCVPR 2021
- StyleCineGAN: Landscape Cinemagraph Generation Using a Pre-trained StyleGANJongwoo Choi, Kwanggyoon Seo, Amirsaman Ashtari, Junyong NohCVPR 2024
- Implicit Warping for Animation with Image SetsArun Mallya, Ting-Chun Wang, Ming-Yu LiuNeurIPS 2022 · 62 citations
- MegaPortraits: One-shot Megapixel Neural Head AvatarsNikita Drobyshev, Jenya Chelishev, Taras Khakhulin, Aleksei Ivakhnenko et al.ACM MM 2022 · 86 citations
