Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image

About

Although significant improvement has been achieved recently in 3D human pose estimation, most of the previous methods only treat a single-person case. In this work, we firstly propose a fully learning-based, camera distance-aware top-down approach for 3D multi-person pose estimation from a single RGB image. The pipeline of the proposed system consists of human detection, absolute 3D human root localization, and root-relative 3D single-person pose estimation modules. Our system achieves comparable results with the state-of-the-art 3D single-person pose estimation models without any groundtruth information and significantly outperforms previous 3D multi-person pose estimation methods on publicly available datasets. The code is available in https://github.com/mks0601/3DMPPE_ROOTNET_RELEASE , https://github.com/mks0601/3DMPPE_POSENET_RELEASE.

Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee• 2019

Related benchmarks

TaskDatasetResultRank
3D Human Pose EstimationHuman3.6M (test)--
547
3D Human Pose Estimation3DPW (test)--
505
3D Human Pose EstimationHuman3.6M (Protocol #1)
MPJPE (Avg.)34
440
3D Human Pose EstimationHuman3.6M (Protocol 2)
Average MPJPE35.2
315
3D Human Pose EstimationHuman3.6M Protocol 1 (test)
Dir. Error (Protocol 1)31
183
3D Human Pose EstimationHuman3.6M (subjects 9 and 11)--
180
3D Human Pose EstimationHuman3.6M--
160
3D Pose EstimationHuman3.6M--
66
Multi-person 3D Pose EstimationMuPoTS-3D (test)
3DPCK82.5
41
Multi-person 3D Human Pose EstimationCMU Panoptic
MPJPE (Mean) [mm]63.9
37
Showing 10 of 41 rows

Other info

Code

Follow for update