Multi-Domain Pose Network for Multi-Person Pose Estimation and Tracking
About
Multi-person human pose estimation and tracking in the wild is important and challenging. For training a powerful model, large-scale training data are crucial. While there are several datasets for human pose estimation, the best practice for training on multi-dataset has not been investigated. In this paper, we present a simple network called Multi-Domain Pose Network (MDPN) to address this problem. By treating the task as multi-domain learning, our methods can learn a better representation for pose prediction. Together with prediction heads fine-tuning and multi-branch combination, it shows significant improvement over baselines and achieves the best performance on PoseTrack ECCV 2018 Challenge without additional datasets other than MPII and COCO.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Human Pose Estimation | PoseTrack 2018 (val) | Total Score75 | 78 | |
| Human Pose Estimation | PoseTrack 2017 (val) | Total Accuracy80.7 | 54 | |
| Multi-person Pose Estimation | PoseTrack 2017 (val) | mAP (Total)80.7 | 39 | |
| Multi-person pose tracking | PoseTrack 2017 (val) | mAP80.7 | 30 | |
| Multi-person pose tracking | PoseTrack 2018 (val) | mAP71.7 | 25 | |
| Multi-person Pose Estimation | PoseTrack 2018 (test) | Ankle Joint Accuracy76.4 | 19 |