RMPE: Regional Multi-person Pose Estimation
About
Multi-person pose estimation in the wild is challenging. Although state-of-the-art human detectors have demonstrated good performance, small errors in localization and recognition are inevitable. These errors can cause failures for a single-person pose estimator (SPPE), especially for methods that solely depend on human detection results. In this paper, we propose a novel regional multi-person pose estimation (RMPE) framework to facilitate pose estimation in the presence of inaccurate human bounding boxes. Our framework consists of three components: Symmetric Spatial Transformer Network (SSTN), Parametric Pose Non-Maximum-Suppression (NMS), and Pose-Guided Proposals Generator (PGPG). Our method is able to handle inaccurate bounding boxes and redundant detections, allowing it to achieve a 17% increase in mAP over the state-of-the-art methods on the MPII (multi person) dataset.Our model and source codes are publicly available.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Human Pose Estimation | COCO (test-dev) | AP72.3 | 408 | |
| Human Pose Estimation | MPII (test) | Shoulder PCK86.5 | 314 | |
| Human Pose Estimation | COCO 2017 (test-dev) | AP72.3 | 180 | |
| Multi-person Pose Estimation | CrowdPose (test) | AP61 | 177 | |
| Multi-person Pose Estimation | COCO 2017 (test-dev) | AP72.3 | 99 | |
| Pose Estimation | OCHuman (test) | AP30.7 | 95 | |
| Human Pose Estimation | PoseTrack 2018 (val) | Total Score71.9 | 78 | |
| 2D Human Pose Estimation | MPII (val) | Head88.4 | 61 | |
| Multi-person Pose Estimation | MPII Multi-Person full (test) | Head Joint Accuracy91.3 | 47 | |
| Keypoint Detection | COCO (test-dev) | AP72.3 | 46 |