Dynamic Future Net: Diversified Human Motion Generation
Wenheng Chen, He Wang, Yi Yuan, Tianjia Shao, Kun Zhou
Abstract
Human motion modelling is crucial in many areas such as computergraphics, vision and virtual reality. Acquiring high-quality skele-tal motions is difficult due to the need for specialized equipmentand laborious manual post-posting, which necessitates maximiz-ing the use of existing data to synthesize new data. However, it is a challenge due to the intrinsic motion stochasticity of humanmotion dynamics, manifested in the short and long terms. In theshort term, there is strong randomness within a couple frames, e.g.one frame followed by multiple possible frames leading to differentmotion styles; while in the long term, there are non-deterministicaction transitions. In this paper, we present Dynamic Future Net,a new deep learning model where we explicitly focuses on the aforementioned motion stochasticity by constructing a generative model with non-trivial modelling capacity in temporal stochas-ticity. Given limited amounts of data, our model can generate a large number of high-quality motions with arbitrary duration, andvisually-convincing variations in both space and time. We evaluateour model on a wide range of motions and compare it with the state-of-the-art methods. Both qualitative and quantitative results show the superiority of our method, for its robustness, versatility and high-quality.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 79673e0c-b29d-4283-af16-d92ffa7b9559Cited by top-tier papers9
- MultiAct: Long-Term 3D Human Motion Generation from Multiple Action LabelsTaeryung Lee, Gyeongsik Moon, Kyoung Mu LeeAAAI 2023 · 62 citations
- Real-time controllable motion transition for charactersXiangjun Tang, He Wang, Bo Hu, Xu Gong et al.SIGGRAPH 2022 · 57 citations
- Motion Prediction via Joint Dependency Modeling in Phase SpacePengxiang Su, Zhenguang Liu, Shuang Wu, Lei Zhu et al.ACM MM 2021 · 22 citations
- RSMT: Real-time Stylized Motion Transition for CharactersXiangjun Tang, Linjun Wu, He Wang, Bo Hu et al.SIGGRAPH 2023 · 19 citations
- Learning Human Motion Prediction via Stochastic Differential EquationsKedi Lyu, Zhenguang Liu, Shuang Wu, Haipeng Chen et al.ACM MM 2021 · 14 citations
Builds on4
- Dream to Control: Learning Behaviors by Latent ImaginationDanijar Hafner, Timothy P. Lillicrap, Jimmy Ba, Mohammad NorouziICLR 2020 · 1,852 citations
- Learning Trajectory Dependencies for Human Motion PredictionWei Mao, Miaomiao Liu, Mathieu Salzmann, Hongdong LiICCV 2019 · 534 citations
- Human Motion Prediction via Spatio-Temporal InpaintingAlejandro Hernandez Ruiz, Jürgen Gall, Francesc MorenoICCV 2019 · 233 citations
- Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent TransitionsZhenyi Wang, Ping Yu, Yang Zhao, Ruiyi Zhang et al.AAAI 2020 · 73 citations
Related papers
- Generating Smooth Pose Sequences for Diverse Human Motion PredictionWei Mao, Miaomiao Liu, Mathieu SalzmannICCV 2021 · 101 citations
- Weakly-supervised Action Transition Learning for Stochastic Human Motion PredictionWei Mao, Miaomiao Liu, Mathieu SalzmannCVPR 2022 · 29 citations
- Motion Diversification NetworksHee Jae Kim, Eshed Ohn-BarCVPR 2024
- Learning Dynamic Relationships for 3D Human Motion PredictionQiongjie Cui, Huaijiang Sun, Fei YangCVPR 2020
- A Stochastic Conditioning Scheme for Diverse Human Motion PredictionMohammad Sadegh Aliakbarian, Fatemeh Sadat Saleh, Mathieu Salzmann, Lars Petersson et al.CVPR 2020
