Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Learning Temporal 3D Human Pose Estimation with Pseudo-Labels

About

We present a simple, yet effective, approach for self-supervised 3D human pose estimation. Unlike the prior work, we explore the temporal information next to the multi-view self-supervision. During training, we rely on triangulating 2D body pose estimates of a multiple-view camera system. A temporal convolutional neural network is trained with the generated 3D ground-truth and the geometric multi-view consistency loss, imposing geometrical constraints on the predicted 3D body skeleton. During inference, our model receives a sequence of 2D body pose estimates from a single-view to predict the 3D body pose for each of them. An extensive evaluation shows that our method achieves state-of-the-art performance in the Human3.6M and MPI-INF-3DHP benchmarks. Our code and models are publicly available at \url{https://github.com/vru2020/TM_HPE/}.

Arij Bouazizi, Ulrich Kressel, Vasileios Belagiannis• 2021

Related benchmarks

TaskDatasetResultRank
3D Human Pose EstimationMPI-INF-3DHP (test)
PCK81
559
3D Human Pose EstimationHuman3.6M (Protocol #1)
MPJPE (Avg.)50.6
440
3D Human Pose EstimationHuman3.6M Protocol #2 (test)
Average Error40
140
Showing 3 of 3 rows

Other info

Code

Follow for update