Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MetaPose: Fast 3D Pose from Multiple Views without 3D Supervision

About

In the era of deep learning, human pose estimation from multiple cameras with unknown calibration has received little attention to date. We show how to train a neural model to perform this task with high precision and minimal latency overhead. The proposed model takes into account joint location uncertainty due to occlusion from multiple views, and requires only 2D keypoint data for training. Our method outperforms both classical bundle adjustment and weakly-supervised monocular 3D baselines on the well-established Human3.6M dataset, as well as the more challenging in-the-wild Ski-Pose PTZ dataset.

Ben Usman, Andrea Tagliasacchi, Kate Saenko, Avneesh Sud• 2021

Related benchmarks

TaskDatasetResultRank
3D Human Pose EstimationHuman3.6M (test)--
547
3D Human Pose EstimationSkiPose
PMPJPE30
12
3D Pose EstimationSkiPose (test)
PMPJPE30
12
3D Human Pose EstimationSkiPose-PTZ (test)
NMPJPE (mm)53
8
Showing 4 of 4 rows

Other info

Code

Follow for update