STyMo: Fast and Controllable Few-Shot Motion Style Transfer
Jose Luis Ponton, Alexander W. Winkler, Ladislav Kavan, Yuting Ye, Petr Kadlecek
摘要
Supporting a wide variety of motion styles is critical for creating diverse virtual characters, but current methods either require large stylized datasets or pre-trained models that cannot generalize beyond their training distribution. We present STyMo, a few-shot approach that learns motion style from only seconds of paired data and trains in one to two minutes. Our key insight is to decompose style into two components: a static component capturing time-invariant posture, and a temporal component capturing frame-wise dynamics. This decomposition yields an interpretable system where posture intensity, temporal exaggeration, and per-body-region style can be adjusted at runtime. Furthermore, the reduction in required training data and computation time structurally permits an iterative authoring workflow. To ensure robustness on arbitrary inputs, we further introduce a stylizability gate that automatically prevents artifacts on out-of-distribution motions. We demonstrate results across diverse motion styles, from subtle emotional variations to exaggerated character archetypes, and release our processed paired dataset to facilitate future research. The source code used in this paper can be found at: https://github.com/facebookresearch/STyMo
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper19
- HuMoR: 3D Human Motion Model for Robust Pose EstimationDavis Rempe, Tolga Birdal, Aaron Hertzmann, Jimei Yang 等ICCV 2021 · 被引用 398 次
- MeshTalk: 3D Face Animation from Speech using Cross-Modality DisentanglementAlexander Richard, Michael Zollhöfer, Yandong Wen, Fernando De la Torre 等ICCV 2021 · 被引用 272 次
- Character controllers using motion VAEsHung Yu Ling, Fabio Zinno, George Cheng, Michiel van de PanneSIGGRAPH 2020 · 被引用 261 次
- Skeleton-aware networks for deep motion retargetingKfir Aberman, Peizhuo Li, Dani Lischinski, Olga Sorkine-Hornung 等SIGGRAPH 2020 · 被引用 210 次
- Unpaired motion style transfer from video to animationKfir Aberman, Yijia Weng, Dani Lischinski, Daniel Cohen-Or 等SIGGRAPH 2020 · 被引用 178 次
相关 Paper
- Visual Captioning at Will: Describing Images and Videos Guided by a Few Stylized SentencesDingyi Yang, Hongyu Chen, Xinglin Hou, Tiezheng Ge 等ACM MM 2023 · 被引用 5 次
- Generative Motion Stylization of Cross-structure Characters within Canonical Motion SpaceJiaxu Zhang, Xin Chen, Gang Yu, Zhigang TuACM MM 2024 · 被引用 9 次
- Style-ERD: Responsive and Coherent Online Motion Style TransferTianxin Tao, Xiaohang Zhan, Zhongquan Chen, Michiel van de PanneCVPR 2022 · 被引用 30 次
- CoolMoves: User Motion Accentuation in Virtual RealityKaran Ahuja, Eyal Ofek, Mar González-Franco, Christian Holz 等UbiComp 2021 · 被引用 69 次
- CALM: Conditional Adversarial Latent Models for Directable Virtual CharactersChen Tessler, Yoni Kasten, Yunrong Guo, Shie Mannor 等SIGGRAPH 2023 · 被引用 59 次
