Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

RMPE: Regional Multi-person Pose Estimation

About

Multi-person pose estimation in the wild is challenging. Although state-of-the-art human detectors have demonstrated good performance, small errors in localization and recognition are inevitable. These errors can cause failures for a single-person pose estimator (SPPE), especially for methods that solely depend on human detection results. In this paper, we propose a novel regional multi-person pose estimation (RMPE) framework to facilitate pose estimation in the presence of inaccurate human bounding boxes. Our framework consists of three components: Symmetric Spatial Transformer Network (SSTN), Parametric Pose Non-Maximum-Suppression (NMS), and Pose-Guided Proposals Generator (PGPG). Our method is able to handle inaccurate bounding boxes and redundant detections, allowing it to achieve a 17% increase in mAP over the state-of-the-art methods on the MPII (multi person) dataset.Our model and source codes are publicly available.

Hao-Shu Fang, Shuqin Xie, Yu-Wing Tai, Cewu Lu• 2016

Related benchmarks

TaskDatasetResultRank
Human Pose EstimationCOCO (test-dev)
AP72.3
408
Human Pose EstimationMPII (test)
Shoulder PCK86.5
314
Human Pose EstimationCOCO 2017 (test-dev)
AP72.3
180
Multi-person Pose EstimationCrowdPose (test)
AP61
177
Multi-person Pose EstimationCOCO 2017 (test-dev)
AP72.3
99
Pose EstimationOCHuman (test)
AP30.7
95
Human Pose EstimationPoseTrack 2018 (val)
Total Score71.9
78
2D Human Pose EstimationMPII (val)
Head88.4
61
Multi-person Pose EstimationMPII Multi-Person full (test)
Head Joint Accuracy91.3
47
Keypoint DetectionCOCO (test-dev)
AP72.3
46
Showing 10 of 26 rows

Other info

Code

Follow for update