Automatic Animation of Hair Blowing in Still Portrait Photos
Wenpeng Xiao, Wentao Liu, Yitong Wang, Bernard Ghanem, Bing Li
Abstract
We propose a novel approach to animate human hair in a still portrait photo. Existing work has largely studied the animation of fluid elements such as water and fire. However, hair animation for a real image remains underexplored, which is a challenging problem, due to the high complexity of hair structure and dynamics. Considering the complexity of hair structure, we innovatively treat hair wisp extraction as an instance segmentation problem, where a hair wisp is referred to as an instance. With advanced instance segmentation networks, our method extracts meaningful and natural hair wisps. Furthermore, we propose a wisp-aware animation module that animates hair wisps with pleasing motions without noticeable artifacts. The extensive experiments show the superiority of our method. Our method provides the most pleasing and compelling viewing experience in the qualitative experiments, and outperforms state-of-the-art still-image animation methods by a large margin in the quantitative evaluation. Project url: https://nevergiveu.github.io/AutomaticHairBlowing/
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 59ff19cc-bb9d-4673-bd1c-37ec9d781456Cited by top-tier papers6
- Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion ModelingXiaoyu Shi, Zhaoyang Huang, Fu-Yun Wang, Weikang Bian et al.SIGGRAPH 2024 · 66 citations
- Follow-Your-Click: Open-domain Regional Image Animation via Motion PromptsYue Ma, Yingqing He, Hongfa Wang, Andong Wang et al.AAAI 2025 · 57 citations
- Vivid-ZOO: Multi-View Video Generation with Diffusion ModelBing Li, Cheng Zheng, Wenxuan Zhu, Jinjie Mai et al.NeurIPS 2024 · 48 citations
- PIA: Your Personalized Image Animator via Plug-and-Play Modules in Text-to-Image ModelsYiming Zhang, Zhening Xing, Yanhong Zeng, Youqing Fang et al.CVPR 2024 · 18 citations
- Consistent and Controllable Image Animation with Motion Diffusion ModelsXin Ma, Yaohui Wang, Gengyun Jia, Xinyuan Chen et al.CVPR 2025
Builds on23
- Vision Transformers for Dense PredictionRené Ranftl, Alexey Bochkovskiy, Vladlen KoltunICCV 2021 · 2,647 citations
- Video Self-Stitching Graph Network for Temporal Action LocalizationChen Zhao, Ali K. Thabet, Bernard GhanemICCV 2021 · 179 citations
- Improved Conditional VRNNs for Video PredictionLluís Castrejón, Nicolas Ballas, Aaron C. CourvilleICCV 2019 · 177 citations
- Blind Video Temporal Consistency via Deep Video PriorChenyang Lei, Yazhou Xing, Qifeng ChenNeurIPS 2020 · 134 citations
- iPOKE: Poking a Still Image for Controlled Stochastic Video SynthesisAndreas Blattmann, Timo Milbich, Michael Dorkenwald, Björn OmmerICCV 2021 · 50 citations
Related papers
- NeuralHDHair: Automatic High-fidelity Hair Modeling from a Single Image Using Implicit Neural RepresentationsKeyu Wu, Yifan Ye, Lingchen Yang, Hongbo Fu et al.CVPR 2022 · 37 citations
- NeuWigs: A Neural Dynamic Model for Volumetric Hair Capture and AnimationZiyan Wang, Giljoo Nam, Tuur Stuyck, Stephen Lombardi et al.CVPR 2023
- Intuitive, Interactive Beard and Hair Synthesis With Generative ModelsKyle Olszewski, Duygu Ceylan, Jun Xing, Jose Echevarria et al.CVPR 2020
- Generalizable One-shot 3D Neural Head AvatarXueting Li, Shalini De Mello, Sifei Liu, Koki Nagano et al.NeurIPS 2023 · 12 citations
- RealPortrait: Realistic Portrait Animation with Diffusion TransformersZejun Yang, Huawei Wei, Zhisheng WangAAAI 2025 · 2 citations
