Breathing Life Into Sketches Using Text-to-Video Priors
Rinon Gal, Yael Vinker, Yuval Alaluf, Amit Bermano, Daniel Cohen-Or, Ariel Shamir, Gal Chechik
2024Year
20Top-tier citations
Abstract
The penguin is shuffling, taking cautious steps." "The jazz saxophonist performs on stage." + + "The gazelle galloping and jumping." + Figure 1. Given a still sketch in vector format and a text prompt describing a desired action, our method automatically animates the drawing with respect to the prompt. Please see the full animations in our project page: https://livesketch.github.io/
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers20
- Text-to-Vector Generation with Neural Path RepresentationPeiying Zhang, Nanxuan Zhao, Jing LiaoSIGGRAPH 2024 · 15 citations
- Dynamic Typography: Bringing Text to Life via Video Diffusion PriorZichen Liu, Yihao Meng, Hao Ouyang, Yue Yu et al.ICCV 2025 · 15 citations
- Sketch2Anim: Towards Transferring Sketch Storyboards into 3D AnimationLei Zhong, Chuan Guo, Yiming Xie, Jiawei Wang et al.SIGGRAPH 2025 · 13 citations
- VAnim: Rendering-Aware Sparse State Modeling for Structure-Preserving Vector AnimationGuotao Liang, Zhangcheng Wang, Chuang Wang, Juncheng Hu et al.ICML 2026 · 11 citations
- LottieGPT: Tokenizing Vector Animation for Autoregressive GenerationJunhao Chen, Kejun Gao, Yuehan Cui, Mingze Sun et al.CVPR 2026 · 10 citations
Builds on27
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video GeneratorsLevon Khachatryan, Andranik Movsisyan, Vahram Tadevosyan, Roberto Henschel et al.ICCV 2023 · 800 citations
- Structure and Content-Guided Video Synthesis with Diffusion ModelsPatrick Esser, Johnathan Chiu, Parmida Atighehchian, Jonathan Granskog et al.ICCV 2023 · 733 citations
- DreamFusion: Text-to-3D using 2D DiffusionBen Poole, Ajay Jain, Jonathan T. Barron, Ben MildenhallICLR 2023 · 463 citations
- TokenFlow: Consistent Diffusion Features for Consistent Video EditingMichal Geyer, Omer Bar-Tal, Shai Bagon, Tali DekelICLR 2024 · 439 citations
Related papers
- Multi-Object Sketch Animation with Grouping and Motion Trajectory PriorsGuotao Liang, Juncheng Hu, Ximing Xing, Jing Zhang et al.ACM MM 2025 · 4 citations
- SketchVideo: Sketch-based Video Generation and EditingFeng-Lin Liu, Hongbo Fu, Xintao Wang, Weicai Ye et al.CVPR 2025
- FlipSketch: Flipping Static Drawings to Text-Guided Sketch AnimationsHmrishav Bandyopadhyay, Yi-Zhe SongCVPR 2025
- Empowering Vector Graphics with Consistently Arbitrary Viewing and View-dependent VisibilityYidi Li, Jun Xiao, Zhengda Lu, Yiqun Wang et al.CVPR 2025
- StickMotion: Generating 3D Human Motions by Drawing a StickmanTao Wang, Zhihua Wu, Qiaozhi He, Jiaming Chu et al.CVPR 2025
