Learning Dynamic Relationships for 3D Human Motion Prediction
Qiongjie Cui, Huaijiang Sun, Fei Yang
Abstract
3D human motion prediction, i.e., forecasting future sequences from given historical poses, is a fundamental task for action analysis, human-computer interaction, machine intelligence. Recently, the state-of-the-art method assumes that the whole human motion sequence involves a fullyconnected graph formed by links between each joint pair. Although encouraging performance has been made, due to the neglect of the inherent and meaningful characteristics of the natural connectivity of human joints, unexpected results may be produced. Moreover, such a complicated topology greatly increases the training difficulty. To tackle these issues, we propose a deep generative model based on graph networks and adversarial learning. Specifically, the skeleton pose is represented as a novel dynamic graph, in which natural connectivities of the joint pairs are exploited explicitly, and the links of geometrically separated joints can also be learned implicitly. Notably, in the proposed model, the natural connection strength is adaptively learned, whereas, in previous schemes, it was constant. Our approach is evaluated on two representations (i.e., angle-based, positionbased) from various large-scale 3D skeleton benchmarks (e.g., H3.6M, CMU, 3DPW MoCap). Extensive experiments demonstrate that our approach achieves significant improvements against existing baselines in accuracy and visualization. Code will be available at https://github. com/cuiqiongjie/LDRGCN .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c35916d7-e6ca-44a4-9ccb-66ab17acf881Cited by top-tier papers37
- MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion PredictionLingwei Dang, Yongwei Nie, Chengjiang Long, Qing Zhang et al.ICCV 2021 · 252 citations
- Synthesis of Compositional Animations from Textual DescriptionsAnindita Ghosh, Noshaba Cheema, Cennet Oguz, Christian Theobalt et al.ICCV 2021 · 226 citations
- Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion PredictionTiezheng Ma, Yongwei Nie, Chengjiang Long, Qing Zhang et al.CVPR 2022 · 150 citations
- Spatio-Temporal Gating-Adjacency GCN for Human Motion PredictionChongyang Zhong, Lei Hu, Zihao Zhang, Yongjing Ye et al.CVPR 2022 · 120 citations
- Towards Diverse and Natural Scene-aware 3D Human Motion SynthesisJingbo Wang, Yu Rong, Jingyuan Liu, Sijie Yan et al.CVPR 2022 · 74 citations
Builds on2
Related papers
- Dynamic Multiscale Graph Neural Networks for 3D Skeleton Based Human Motion PredictionMaosen Li, Siheng Chen, Yangheng Zhao, Ya Zhang et al.CVPR 2020
- Motion Prediction using Trajectory CuesZhenguang Liu, Pengxiang Su, Shuang Wu, Xuanjing Shen et al.ICCV 2021 · 63 citations
- Searching Motion Graphs for Human Motion SynthesisChenchen Liu, Yadong MuACM MM 2021 · 2 citations
- Generating Smooth Pose Sequences for Diverse Human Motion PredictionWei Mao, Miaomiao Liu, Mathieu SalzmannICCV 2021 · 101 citations
- Hierarchically Decomposed Graph Convolutional Networks for Skeleton-Based Action RecognitionJungho Lee, Minhyeok Lee, Dogyoon Lee, Sangyoun LeeICCV 2023 · 236 citations
