Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Adversarial Parametric Pose Prior

About

The Skinned Multi-Person Linear (SMPL) model can represent a human body by mapping pose and shape parameters to body meshes. This has been shown to facilitate inferring 3D human pose and shape from images via different learning models. However, not all pose and shape parameter values yield physically-plausible or even realistic body meshes. In other words, SMPL is under-constrained and may thus lead to invalid results when used to reconstruct humans from images, either by directly optimizing its parameters, or by learning a mapping from the image to these parameters. In this paper, we therefore learn a prior that restricts the SMPL parameters to values that produce realistic poses via adversarial training. We show that our learned prior covers the diversity of the real-data distribution, facilitates optimization for 3D reconstruction from 2D keypoints, and yields better pose estimates when used for regression from images. We found that the prior based on spherical distribution gets the best results. Furthermore, in all these tasks, it outperforms the state-of-the-art VAE-based approach to constraining the SMPL parameters.

Andrey Davydov, Anastasia Remizova, Victor Constantin, Sina Honari, Mathieu Salzmann, Pascal Fua• 2021

Related benchmarks

TaskDatasetResultRank
3D Human Pose EstimationHuman3.6M (test)--
547
3D Human Pose EstimationHuman3.6M (Protocol 2)
Average MPJPE84.3
315
Long-term Human Motion PredictionAMASS (test)
MAE6.2
9
Pose GenerationAMASS (test)
FID0.201
8
Human Pose Prior EvaluationAMASS (test)
Mean Recall (mm)3.76
6
Interpolation SmoothnessH3.6M
Mean Smoothness4.3
4
Pose Generation RecallAMASS (train)
Mean Distance3.9
4
2D to 3D upliftingAMASS (test)
MPJPE (1)61.5
4
Inverse Kinematics with Partial ObservationAMASS (test)
MPJPE (L)16.8
4
Inverse KinematicsAMASS
MPJPE46.5
4
Showing 10 of 11 rows

Other info

Follow for update