STyMo: Fast and Controllable Few-Shot Motion Style Transfer
Jose Luis Ponton, Alexander W. Winkler, Ladislav Kavan, Yuting Ye, Petr Kadlecek
Abstract
Supporting a wide variety of motion styles is critical for creating diverse virtual characters, but current methods either require large stylized datasets or pre-trained models that cannot generalize beyond their training distribution. We present STyMo, a few-shot approach that learns motion style from only seconds of paired data and trains in one to two minutes. Our key insight is to decompose style into two components: a static component capturing time-invariant posture, and a temporal component capturing frame-wise dynamics. This decomposition yields an interpretable system where posture intensity, temporal exaggeration, and per-body-region style can be adjusted at runtime. Furthermore, the reduction in required training data and computation time structurally permits an iterative authoring workflow. To ensure robustness on arbitrary inputs, we further introduce a stylizability gate that automatically prevents artifacts on out-of-distribution motions. We demonstrate results across diverse motion styles, from subtle emotional variations to exaggerated character archetypes, and release our processed paired dataset to facilitate future research. The source code used in this paper can be found at: https://github.com/facebookresearch/STyMo
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 98b87b93-af38-47ea-b53c-37c69df78029Builds on19
- HuMoR: 3D Human Motion Model for Robust Pose EstimationDavis Rempe, Tolga Birdal, Aaron Hertzmann, Jimei Yang et al.ICCV 2021 · 398 citations
- MeshTalk: 3D Face Animation from Speech using Cross-Modality DisentanglementAlexander Richard, Michael Zollhöfer, Yandong Wen, Fernando De la Torre et al.ICCV 2021 · 272 citations
- Character controllers using motion VAEsHung Yu Ling, Fabio Zinno, George Cheng, Michiel van de PanneSIGGRAPH 2020 · 261 citations
- Skeleton-aware networks for deep motion retargetingKfir Aberman, Peizhuo Li, Dani Lischinski, Olga Sorkine-Hornung et al.SIGGRAPH 2020 · 210 citations
- Unpaired motion style transfer from video to animationKfir Aberman, Yijia Weng, Dani Lischinski, Daniel Cohen-Or et al.SIGGRAPH 2020 · 178 citations
Related papers
- Visual Captioning at Will: Describing Images and Videos Guided by a Few Stylized SentencesDingyi Yang, Hongyu Chen, Xinglin Hou, Tiezheng Ge et al.ACM MM 2023 · 5 citations
- Generative Motion Stylization of Cross-structure Characters within Canonical Motion SpaceJiaxu Zhang, Xin Chen, Gang Yu, Zhigang TuACM MM 2024 · 9 citations
- Style-ERD: Responsive and Coherent Online Motion Style TransferTianxin Tao, Xiaohang Zhan, Zhongquan Chen, Michiel van de PanneCVPR 2022 · 30 citations
- CoolMoves: User Motion Accentuation in Virtual RealityKaran Ahuja, Eyal Ofek, Mar González-Franco, Christian Holz et al.UbiComp 2021 · 69 citations
- CALM: Conditional Adversarial Latent Models for Directable Virtual CharactersChen Tessler, Yoni Kasten, Yunrong Guo, Shie Mannor et al.SIGGRAPH 2023 · 59 citations
