GANimator: neural motion synthesis from a single sequence
Peizhuo Li, Kfir Aberman, Zihan Zhang, Rana Hanocka, Olga Sorkine-Hornung
摘要
Fig. 1. Given a single training motion sequence of skeleton with arbitrary topology, our method learns to synthesize novel motion sequences.
We present GANimator, a generative model that learns to synthesize novel motions from a single, short motion sequence. GANimator generates motions that resemble the core elements of the original motion, while simultaneously synthesizing novel and diverse movements. Existing data-driven techniques for motion synthesis require a large motion dataset which contains the desired and specific skeletal structure. By contrast, GANimator only requires training on a single motion sequence, enabling novel motion synthesis for a variety of skeletal structures e.g., bipeds, quadropeds, hexapeds, and more. Our framework contains a series of generative and adversarial neural networks, each responsible for generating motions in a specific frame rate. The framework progressively learns to synthesize motion from random noise, enabling hierarchical control over the generated motion content across varying levels of detail. We show a number of applications, including crowd simulation, key-frame editing, style transfer, and interactive control, which all learn from a single input sequence. Code and data for this paper are at https://peizhuoli.github.io/ganimator.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper28
- GestureDiffuCLIP: Gesture Diffusion Model with CLIP LatentsTenglong Ao, Zeyi Zhang, Libin LiuSIGGRAPH 2023 · 被引用 151 次
- Synthesizing Diverse Human Motions in 3D Indoor ScenesKaifeng Zhao, Yan Zhang, Shaofei Wang, Thabo Beeler 等ICCV 2023 · 被引用 116 次
- Single Motion DiffusionSigal Raab, Inbal Leibovitch, Guy Tevet, Moab Arar 等ICLR 2024 · 被引用 81 次
- SINC: Spatial Composition of 3D Human Motions for Simultaneous Action GenerationNikos Athanasiou, Mathis Petrovich, Michael J. Black, Gül VarolICCV 2023 · 被引用 69 次
- Sin3DM: Learning a Diffusion Model from a Single 3D Textured ShapeRundi Wu, Ruoshi Liu, Carl Vondrick, Changxi ZhengICLR 2024 · 被引用 34 次
它引用的顶会 Paper10
- SinGAN: Learning a Generative Model From a Single Natural ImageTamar Rott Shaham, Tali Dekel, Tomer MichaeliICCV 2019 · 被引用 933 次
- Robust motion in-betweeningFélix G. Harvey, Mike Yurick, Derek Nowrouzezahrai, Christopher J. PalSIGGRAPH 2020 · 被引用 269 次
- Skeleton-aware networks for deep motion retargetingKfir Aberman, Peizhuo Li, Dani Lischinski, Olga Sorkine-Hornung 等SIGGRAPH 2020 · 被引用 210 次
- Local motion phases for learning multi-contact character movementsSebastian Starke, Yiwei Zhao, Taku Komura, Kazi A. ZamanSIGGRAPH 2020 · 被引用 186 次
- Unpaired motion style transfer from video to animationKfir Aberman, Yijia Weng, Dani Lischinski, Daniel Cohen-Or 等SIGGRAPH 2020 · 被引用 178 次
相关 Paper
- Example-based Motion Synthesis via Generative Motion MatchingWeiyu Li, Xuelin Chen, Peizhuo Li, Olga Sorkine-Hornung 等SIGGRAPH 2023 · 被引用 24 次
- AnyTop: Character Animation Diffusion with Any TopologyInbar Gat, Sigal Raab, Guy Tevet, Yuval Reshef 等SIGGRAPH 2025 · 被引用 9 次
- Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent TransitionsZhenyi Wang, Ping Yu, Yang Zhao, Ruiyi Zhang 等AAAI 2020 · 被引用 73 次
- Neural animation layering for synthesizing martial arts movementsSebastian Starke, Yiwei Zhao, Fabio Zinno, Taku KomuraSIGGRAPH 2021 · 被引用 75 次
- OmniMotionGPT: Animal Motion Generation with Limited DataZhangsihao Yang, Mingyuan Zhou, Mengyi Shan, Bingbing Wen 等CVPR 2024 · 被引用 6 次
