Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Prediction

About

This paper presents a high-quality human motion prediction method that accurately predicts future human poses given observed ones. Our method is based on the observation that a good initial guess of the future poses is very helpful in improving the forecasting accuracy. This motivates us to propose a novel two-stage prediction framework, including an init-prediction network that just computes the good guess and then a formal-prediction network that predicts the target future poses based on the guess. More importantly, we extend this idea further and design a multi-stage prediction framework where each stage predicts initial guess for the next stage, which brings more performance gain. To fulfill the prediction task at each stage, we propose a network comprising Spatial Dense Graph Convolutional Networks (S-DGCN) and Temporal Dense Graph Convolutional Networks (T-DGCN). Alternatively executing the two networks helps extract spatiotemporal features over the global receptive field of the whole pose sequence. All the above design choices cooperating together make our method outperform previous approaches by large margins: 6%-7% on Human3.6M, 5%-10% on CMU-MoCap, and 13%-16% on 3DPW.

Tiezheng Ma, Yongwei Nie, Chengjiang Long, Qing Zhang, Guiqing Li• 2022

Related benchmarks

TaskDatasetResultRank
Human Motion PredictionHuman3.6M (test)
MPJPE10.6
85
Long-term Human Motion PredictionHuman3.6M
Average Error (MPJPE)60.44
58
Human Motion PredictionHuman3.6M--
46
Human Motion PredictionHuman3.6M (short-term)
Walking MAE9.5
40
Human Motion Prediction3DPW
Trajectory Error (400ms)58.3
27
3D Human Motion PredictionHuman3.6M S5 (test)
Average MPJPE (560ms)76.3
17
3D Human Pose PredictionHuman3.6M (test)
Inference Latency (ms)43
10
Human Pose PredictionHuman3.6M Setting-B
FDE (80ms)10.3
9
3D Human Motion PredictionCMU Mocap (test)
MPJPE - Basketball - 80ms9.53
8
3D Human Skeleton Motion PredictionH3.6M Subject 5 v1 (test)
Walking Error (560ms)48.1
7
Showing 10 of 14 rows

Other info

Code

Follow for update