Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Prediction
Tiezheng Ma, Yongwei Nie, Chengjiang Long, Qing Zhang, Guiqing Li
Abstract
This paper presents a high-quality human motion pre-diction method that accurately predicts future human poses given observed ones. Our method is based on the observation that a good “initial guess” of the future poses is very helpful in improving the forecasting accuracy. This mo-tivates us to propose a novel two-stage prediction frame-work, including an init-prediction network that just computes the good guess and then a formal-prediction network that predicts the target future poses based on the guess. More importantly, we extend this idea further and design a multi-stage prediction framework where each stage pre-dicts initial guess for the next stage, which brings more performance gain. To fulfill the prediction task at each stage, we propose a network comprising Spatial Dense Graph Convolutional Networks (S-DGCN) and Temporal Dense Graph Convolutional Networks (T-DGCN). Alternatively executing the two networks helps extract spatiotem-poral features over the global receptive field of the whole pose sequence. All the above design choices cooperating together make our method outperform previous approaches by large margins: 6%-7% on Human3.6M, 5%-10% on CMU-MoCap, and 13%-16% on 3DPW. Code is available at https://github.com/705062791/PGBIG.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0cf5560e-77f2-4c7a-a35b-817ea61372ecCited by top-tier papers38
- Diverse Human Motion Prediction via Gumbel-Softmax Sampling from an Auxiliary SpaceLingwei Dang, Yongwei Nie, Chengjiang Long, Qing Zhang et al.ACM MM 2022 · 52 citations
- Auxiliary Tasks Benefit 3D Skeleton-based Human Motion PredictionChenxin Xu, Robby T. Tan, Yuhong Tan, Siheng Chen et al.ICCV 2023 · 35 citations
- GCNext: Towards the Unity of Graph Convolutions for Human Motion PredictionXinshun Wang, Qiongjie Cui, Chen Chen, Mengyuan LiuAAAI 2024 · 25 citations
- A Unified Masked Autoencoder with Patchified Skeletons for Motion SynthesisEsteve Valls Mascaro, Hyemin Ahn, Dongheui LeeAAAI 2024 · 11 citations
- Spatio-Temporal Branching for Motion Prediction using Motion IncrementsJiexin Wang, Yujie Zhou, Wenwen Qiang, Ying Ba et al.ACM MM 2023 · 11 citations
Builds on11
- Learning Trajectory Dependencies for Human Motion PredictionWei Mao, Miaomiao Liu, Mathieu Salzmann, Hongdong LiICCV 2019 · 534 citations
- MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion PredictionLingwei Dang, Yongwei Nie, Chengjiang Long, Qing Zhang et al.ICCV 2021 · 252 citations
- Structured Prediction Helps 3D Human Motion ModellingEmre Aksan, Manuel Kaufmann, Otmar HilligesICCV 2019 · 204 citations
- Space-Time-Separable Graph Convolutional Network for Pose ForecastingTheodoros Sofianos, Alessio Sampieri, Luca Franco, Fabio GalassoICCV 2021 · 188 citations
- Dual Graph Convolutional Networks with Transformer and Curriculum Learning for Image CaptioningXinzhi Dong, Chengjiang Long, Wenju Xu, Chunxia XiaoACM MM 2021 · 75 citations
Related papers
- Towards Accurate 3D Human Motion Prediction From Incomplete ObservationsQiongjie Cui, Huaijiang SunCVPR 2021
- Dynamic Multiscale Graph Neural Networks for 3D Skeleton Based Human Motion PredictionMaosen Li, Siheng Chen, Yangheng Zhao, Ya Zhang et al.CVPR 2020
- Spatio-Temporal Gating-Adjacency GCN for Human Motion PredictionChongyang Zhong, Lei Hu, Zihao Zhang, Yongjing Ye et al.CVPR 2022 · 120 citations
- Learning Dynamic Relationships for 3D Human Motion PredictionQiongjie Cui, Huaijiang Sun, Fei YangCVPR 2020
- Generating Smooth Pose Sequences for Diverse Human Motion PredictionWei Mao, Miaomiao Liu, Mathieu SalzmannICCV 2021 · 101 citations
