FlexiClip: Locality-Preserving Free-Form Character Animation
Anant Khandelwal
摘要
Animating clipart images with seamless motion while maintaining visual fidelity and temporal coherence presents significant challenges. Existing methods, such as AniClipart, effectively model spatial deformations but often fail to ensure smooth temporal transitions, resulting in artifacts like abrupt motions and geometric distortions. Similarly, text-to-video (T2V) and imageto-video (I2V) models struggle to handle clipart due to the mismatch in statistical properties between natural video and clipart styles. This paper introduces FlexiClip, a novel approach designed to overcome these limitations by addressing the intertwined challenges of temporal consistency and geometric integrity. FlexiClip extends traditional Bézier curve-based trajectory modeling with key innovations: temporal Jacobians to correct motion dynamics incrementally, continuous-time modeling via probability flow ODEs (pfODEs) to mitigate temporal noise, and a flow matching loss inspired by GFlowNet principles to optimize smooth motion transitions. These enhancements ensure coherent animations across complex scenarios involving rapid movements and non-rigid deformations. Extensive experiments validate the effectiveness of FlexiClip in generating animations that are not only smooth and natural but also structurally consistent across diverse clipart types, including humans and animals. By integrating spatial and temporal modeling with pretrained video diffusion models, FlexiClip sets a new standard for high-quality clipart animation, offering robust performance across a wide range of visual content. Project
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper6
- DreamFusion: Text-to-3D using 2D DiffusionBen Poole, Ajay Jain, Jonathan T. Barron, Ben MildenhallICLR 2023 · 被引用 463 次
- Score-based Generative Modeling through Stochastic Evolution Equations in Hilbert SpacesSungbin Lim, Eun-Bi Yoon, Taehyun Byun, Taewon Kang 等NeurIPS 2023 · 被引用 55 次
- Inflationary Flows: Calibrated Bayesian Inference with Diffusion-Based ModelsDaniela de Albuquerque, John M. PearsonNeurIPS 2024 · 被引用 3 次
- PyramidFlow: High-Resolution Defect Contrastive Localization Using Pyramid Normalizing FlowJiarui Lei, Xiaobo Hu, Yue Wang, Dong LiuCVPR 2023
- VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion ModelsHaoxin Chen, Yong Zhang, Xiaodong Cun, Menghan Xia 等CVPR 2024
相关 Paper
- FlipSketch: Flipping Static Drawings to Text-Guided Sketch AnimationsHmrishav Bandyopadhyay, Yi-Zhe SongCVPR 2025
- FlexTraj: Image-to-Video Generation with Flexible Point Trajectory ControlZhiyuan Zhang, Can Wang, Dongdong Chen, Jing LiaoCVPR 2026 · 被引用 7 次
- NeuroClips: Towards High-fidelity and Smooth fMRI-to-Video ReconstructionZixuan Gong, Guangyin Bao, Qi Zhang, Zhongwei Wan 等NeurIPS 2024 · 被引用 39 次
- Space-Time Diffusion Features for Zero-Shot Text-Driven Motion TransferDanah Yatim, Rafail Fridman, Omer Bar-Tal, Yoni Kasten 等CVPR 2024 · 被引用 29 次
- Let Your Image Move with Your Motion! -- Implicit Multi-Object Multi-Motion TransferLi Yuze, Dong Gong, Xiao Cao, Junchao Yuan 等CVPR 2026 · 被引用 3 次
