Learning Human Motion Prediction via Stochastic Differential Equations
Kedi Lyu, Zhenguang Liu, Shuang Wu, Haipeng Chen, Xuhong Zhang, Yuyu Yin
Abstract
Human motion understanding and prediction is an integral aspect in our pursuit of machine intelligence and human-machine interaction systems. Current methods typically pursue a kinematics modeling approach, relying heavily upon prior anatomical knowledge and constraints. However, such an approach is hard to generalize to different skeletal model representations, and also tends to be inadequate in accounting for the dynamic range and complexity of motion, thus hindering predictive accuracy. In this work, we propose a novel approach in modeling the motion prediction problem based on stochastic differential equations and path integrals. The motion profile of each skeletal joint is formulated as a basic stochastic variable and modeled with the Langevin equation. We develop a strategy of employing GANs to simulate path integrals that amounts to optimizing over possible future paths. We conduct experiments in two large benchmark datasets, Human 3.6M and CMU MoCap. It is highlighted that our approach achieves a 12.48% accuracy improvement over current state-of-the-art methods in average.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 54c4f5a1-4747-41ce-9b92-c5da9447bdd3Cited by top-tier papers4
- Diverse Human Motion Prediction via Gumbel-Softmax Sampling from an Auxiliary SpaceLingwei Dang, Yongwei Nie, Chengjiang Long, Qing Zhang et al.ACM MM 2022 · 52 citations
- Omni-Supervised Motion Editing: Balancing Change and Invariance through Positive-Negative LearningZhenwu Shi, Jingyu Gong, Peiwei Wang, Xingzan Wang et al.CVPR 2026 · 4 citations
- Towards Practical Human Motion Prediction with LiDAR Point CloudsXiao Han, Yiming Ren, Yichen Yao, Yujing Sun et al.ACM MM 2024 · 2 citations
- Rethinking Human Motion Prediction with Symplectic IntegralHaipeng Chen, Kedi Lyu, Zhenguang Liu, Yifang Yin et al.CVPR 2024
Builds on8
- Learning Trajectory Dependencies for Human Motion PredictionWei Mao, Miaomiao Liu, Mathieu Salzmann, Hongdong LiICCV 2019 · 534 citations
- Dynamic GCN: Context-enriched Topology Learning for Skeleton-based Action RecognitionFanfan Ye, Shiliang Pu, Qiaoyong Zhong, Chao Li et al.ACM MM 2020 · 348 citations
- Aggregated Multi-GANs for Controlled 3D Human Motion PredictionZhenguang Liu, Kedi Lyu, Shuang Wu, Haipeng Chen et al.AAAI 2021 · 64 citations
- Weakly-Supervised Video Object Grounding by Exploring Spatio-Temporal ContextsXun Yang, Xueliang Liu, Meng Jian, Xinjian Gao et al.ACM MM 2020 · 47 citations
- Dynamic Future Net: Diversified Human Motion GenerationWenheng Chen, He Wang, Yi Yuan, Tianjia Shao et al.ACM MM 2020 · 20 citations
Related papers
- Human Motion Prediction via Spatio-Temporal InpaintingAlejandro Hernandez Ruiz, Jürgen Gall, Francesc MorenoICCV 2019 · 233 citations
- Learning Dynamic Relationships for 3D Human Motion PredictionQiongjie Cui, Huaijiang Sun, Fei YangCVPR 2020
- Generating Smooth Pose Sequences for Diverse Human Motion PredictionWei Mao, Miaomiao Liu, Mathieu SalzmannICCV 2021 · 101 citations
- Dynamic Multiscale Graph Neural Networks for 3D Skeleton Based Human Motion PredictionMaosen Li, Siheng Chen, Yangheng Zhao, Ya Zhang et al.CVPR 2020
- Motion Prediction via Joint Dependency Modeling in Phase SpacePengxiang Su, Zhenguang Liu, Shuang Wu, Lei Zhu et al.ACM MM 2021 · 22 citations
