Camera Distance-aware Top-down Approach for 3D Multi-person Pose Estimation from a Single RGB Image
About
Although significant improvement has been achieved recently in 3D human pose estimation, most of the previous methods only treat a single-person case. In this work, we firstly propose a fully learning-based, camera distance-aware top-down approach for 3D multi-person pose estimation from a single RGB image. The pipeline of the proposed system consists of human detection, absolute 3D human root localization, and root-relative 3D single-person pose estimation modules. Our system achieves comparable results with the state-of-the-art 3D single-person pose estimation models without any groundtruth information and significantly outperforms previous 3D multi-person pose estimation methods on publicly available datasets. The code is available in https://github.com/mks0601/3DMPPE_ROOTNET_RELEASE , https://github.com/mks0601/3DMPPE_POSENET_RELEASE.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 3D Human Pose Estimation | Human3.6M (test) | -- | 547 | |
| 3D Human Pose Estimation | 3DPW (test) | -- | 505 | |
| 3D Human Pose Estimation | Human3.6M (Protocol #1) | MPJPE (Avg.)34 | 440 | |
| 3D Human Pose Estimation | Human3.6M (Protocol 2) | Average MPJPE35.2 | 315 | |
| 3D Human Pose Estimation | Human3.6M Protocol 1 (test) | Dir. Error (Protocol 1)31 | 183 | |
| 3D Human Pose Estimation | Human3.6M (subjects 9 and 11) | -- | 180 | |
| 3D Human Pose Estimation | Human3.6M | -- | 160 | |
| 3D Pose Estimation | Human3.6M | -- | 66 | |
| Multi-person 3D Pose Estimation | MuPoTS-3D (test) | 3DPCK82.5 | 41 | |
| Multi-person 3D Human Pose Estimation | CMU Panoptic | MPJPE (Mean) [mm]63.9 | 37 |