Local motion phases for learning multi-contact character movements
Sebastian Starke, Yiwei Zhao, Taku Komura, Kazi A. Zaman
Abstract
Training a bipedal character to play basketball and interact with objects, or a quadruped character to move in various locomotion modes, are difficult tasks due to the fast and complex contacts happening during the motion. In this paper, we propose a novel framework to learn fast and dynamic character interactions that involve multiple contacts between the body and an object, another character and the environment, from a rich, unstructured motion capture database. We use one-on-one basketball play and character interactions with the environment as examples. To achieve this task, we propose a novel feature called local motion phase, that can help neural networks to learn asynchronous movements of each bone and its interaction with external objects such as a ball or an environment. We also propose a novel generative scheme to reproduce a wide variation of movements from abstract control signals given by a gamepad, which can be useful for changing the style of the motion under the same context. Our scheme is useful for animating contact-rich, complex interactions for real-time applications such as computer games.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers41
- Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion ModelsSimon Alexanderson, Rajmund Nagy, Jonas Beskow, Gustav Eje HenterSIGGRAPH 2023 · 191 citations
- Spatio-Temporal Gating-Adjacency GCN for Human Motion PredictionChongyang Zhong, Lei Hu, Zihao Zhang, Yongjing Ye et al.CVPR 2022 · 120 citations
- Synthesizing Diverse Human Motions in 3D Indoor ScenesKaifeng Zhao, Yan Zhang, Shaofei Wang, Thabo Beeler et al.ICCV 2023 · 116 citations
- Unified Human-Scene Interaction via Prompted Chain-of-ContactsZeqi Xiao, Tai Wang, Jingbo Wang, Jinkun Cao et al.ICLR 2024 · 113 citations
- Physics-based Human Motion Estimation and Synthesis from VideosKevin Xie, Tingwu Wang, Umar Iqbal, Yunrong Guo et al.ICCV 2021 · 102 citations
Related papers
- Neural animation layering for synthesizing martial arts movementsSebastian Starke, Yiwei Zhao, Fabio Zinno, Taku KomuraSIGGRAPH 2021 · 75 citations
- Simulation and Retargeting of Complex Multi-Character InteractionsYunbo Zhang, Deepak Gopinath, Yuting Ye, Jessica K. Hodgins et al.SIGGRAPH 2023 · 25 citations
- SkillMimic: Learning Basketball Interaction Skills from DemonstrationsYinhuai Wang, Qihan Zhao, Runyi Yu, Hok Wai Tsui et al.CVPR 2025
- PMP: Learning to Physically Interact with Environments using Part-wise Motion PriorsJinseok Bae, Jungdam Won, Donggeun Lim, Cheol-Hui Min et al.SIGGRAPH 2023 · 27 citations
- Catch & Carry: reusable neural controllers for vision-guided whole-body tasksJosh Merel, Saran Tunyasuvunakool, Arun Ahuja, Yuval Tassa et al.SIGGRAPH 2020 · 103 citations
