GANimator: neural motion synthesis from a single sequence
Peizhuo Li, Kfir Aberman, Zihan Zhang, Rana Hanocka, Olga Sorkine-Hornung
Abstract
Fig. 1. Given a single training motion sequence of skeleton with arbitrary topology, our method learns to synthesize novel motion sequences.
We present GANimator, a generative model that learns to synthesize novel motions from a single, short motion sequence. GANimator generates motions that resemble the core elements of the original motion, while simultaneously synthesizing novel and diverse movements. Existing data-driven techniques for motion synthesis require a large motion dataset which contains the desired and specific skeletal structure. By contrast, GANimator only requires training on a single motion sequence, enabling novel motion synthesis for a variety of skeletal structures e.g., bipeds, quadropeds, hexapeds, and more. Our framework contains a series of generative and adversarial neural networks, each responsible for generating motions in a specific frame rate. The framework progressively learns to synthesize motion from random noise, enabling hierarchical control over the generated motion content across varying levels of detail. We show a number of applications, including crowd simulation, key-frame editing, style transfer, and interactive control, which all learn from a single input sequence. Code and data for this paper are at https://peizhuoli.github.io/ganimator.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8ed8d214-949a-4a24-9d15-6f5daf3d8acaCited by top-tier papers28
- GestureDiffuCLIP: Gesture Diffusion Model with CLIP LatentsTenglong Ao, Zeyi Zhang, Libin LiuSIGGRAPH 2023 · 151 citations
- Synthesizing Diverse Human Motions in 3D Indoor ScenesKaifeng Zhao, Yan Zhang, Shaofei Wang, Thabo Beeler et al.ICCV 2023 · 116 citations
- Single Motion DiffusionSigal Raab, Inbal Leibovitch, Guy Tevet, Moab Arar et al.ICLR 2024 · 81 citations
- SINC: Spatial Composition of 3D Human Motions for Simultaneous Action GenerationNikos Athanasiou, Mathis Petrovich, Michael J. Black, Gül VarolICCV 2023 · 69 citations
- Sin3DM: Learning a Diffusion Model from a Single 3D Textured ShapeRundi Wu, Ruoshi Liu, Carl Vondrick, Changxi ZhengICLR 2024 · 34 citations
Builds on10
- SinGAN: Learning a Generative Model From a Single Natural ImageTamar Rott Shaham, Tali Dekel, Tomer MichaeliICCV 2019 · 933 citations
- Robust motion in-betweeningFélix G. Harvey, Mike Yurick, Derek Nowrouzezahrai, Christopher J. PalSIGGRAPH 2020 · 269 citations
- Skeleton-aware networks for deep motion retargetingKfir Aberman, Peizhuo Li, Dani Lischinski, Olga Sorkine-Hornung et al.SIGGRAPH 2020 · 210 citations
- Local motion phases for learning multi-contact character movementsSebastian Starke, Yiwei Zhao, Taku Komura, Kazi A. ZamanSIGGRAPH 2020 · 186 citations
- Unpaired motion style transfer from video to animationKfir Aberman, Yijia Weng, Dani Lischinski, Daniel Cohen-Or et al.SIGGRAPH 2020 · 178 citations
Related papers
- Example-based Motion Synthesis via Generative Motion MatchingWeiyu Li, Xuelin Chen, Peizhuo Li, Olga Sorkine-Hornung et al.SIGGRAPH 2023 · 24 citations
- AnyTop: Character Animation Diffusion with Any TopologyInbar Gat, Sigal Raab, Guy Tevet, Yuval Reshef et al.SIGGRAPH 2025 · 9 citations
- Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent TransitionsZhenyi Wang, Ping Yu, Yang Zhao, Ruiyi Zhang et al.AAAI 2020 · 73 citations
- Neural animation layering for synthesizing martial arts movementsSebastian Starke, Yiwei Zhao, Fabio Zinno, Taku KomuraSIGGRAPH 2021 · 75 citations
- OmniMotionGPT: Animal Motion Generation with Limited DataZhangsihao Yang, Mingyuan Zhou, Mengyi Shan, Bingbing Wen et al.CVPR 2024 · 6 citations
