Notational Animating: An Interactive Approach to Creating and Editing Animation Keyframes
Xinyu Shi, Li-Yi Wei, Nanxuan Zhao, Jian Zhao, Rubaiat Habib Kazi
Abstract
We introduce the concept of notational animating, an interaction paradigm for animation authoring where users sketch high-level notations over static drawings to indicate intended motions, which are then interpreted by automatic methods (e.g., GenAI models) to generate animation keyframes. Sketched notations have long served as cognitive instruments for animators, capturing forces, poses, dynamics, paths, and other animation features. However, such notations are often contextual, ambiguous, and combinational based on our analysis of 135 real-world sketches. To facilitate interpretation, we first formalize these notations into a structured animation representation (i.e., source, path, and target). We then built an animation authoring system that translates high-level notations into the formalized intended animation, provides dynamic UI widgets for fine-grained parameter control, and establishes a closed feedback loop to resolve ambiguity. Finally, through a preliminary study with animators, we assess the usability of notational animating, reflect its affordance, and identify its contexts of use.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on20
- Blended Latent DiffusionOmri Avrahami, Ohad Fried, Dani LischinskiSIGGRAPH 2023 · 339 citations
- The Metacognitive Demands and Opportunities of Generative AILev Tankelevitch, Viktor Kewenig, Auste Simkute, Ava Elizabeth Scott et al.CHI 2024 · 279 citations
- Design Principles for Generative AI ApplicationsJustin D. Weisz, Jessica He, Michael J. Muller, Gabriela Hoefer et al.CHI 2024 · 221 citations
- Drag Your GAN: Interactive Point-based Manipulation on the Generative Image ManifoldXingang Pan, Ayush Tewari, Thomas Leimkühler, Lingjie Liu et al.SIGGRAPH 2023 · 206 citations
- TaleBrush: Sketching Stories with Generative Pretrained Language ModelsJohn Joon Young Chung, Wooseok Kim, Kang Min Yoo, Hwaran Lee et al.CHI 2022 · 202 citations
Related papers
- SketchDynamics: Exploring Free-Form Sketches for Dynamic Intent Expression in Animation GenerationBoyu Li, Lin-Ping Yuan, Zeyu Wang, Hongbo FuCHI 2026 · 1 citation
- Shape n' Swarm: Hands-on, Shape-aware Generative Authoring with Swarm UI and LLMsMatthew Jeung, Anup Sathya, Wanli Qian, Steven Arellano et al.UIST 2025 · 1 citation
- Squidgets: Sketch-based Widget Design for Scene ManipulationJoonho Kim, Fanny Chevalier, Karan SinghUIST 2025
- Rapid design of articulated objectsJoon Hyub Lee, Hanbit Kim, Seok-Hyung BaeSIGGRAPH 2022 · 20 citations
- Code Shaping: Iterative Code Editing with Free-form AI-Interpreted SketchingRyan Yen, Jian Zhao, Daniel VogelCHI 2025 · 32 citations
