Pose Flow: Efficient Online Pose Tracking
About
Multi-person articulated pose tracking in unconstrained videos is an important while challenging problem. In this paper, going along the road of top-down approaches, we propose a decent and efficient pose tracker based on pose flows. First, we design an online optimization framework to build the association of cross-frame poses and form pose flows (PF-Builder). Second, a novel pose flow non-maximum suppression (PF-NMS) is designed to robustly reduce redundant pose flows and re-link temporal disjoint ones. Extensive experiments show that our method significantly outperforms best-reported results on two standard Pose Tracking datasets by 13 mAP 25 MOTA and 6 mAP 3 MOTA respectively. Moreover, in the case of working on detected poses in individual frames, the extra computation of pose tracker is very minor, guaranteeing online 10FPS tracking. Our source codes are made publicly available(https://github.com/YuliangXiu/PoseFlow).
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Human Pose Estimation | PoseTrack 2017 (val) | Total Accuracy66.5 | 54 | |
| Multi-person Pose Estimation | PoseTrack 2017 (test) | Total mAP63 | 39 | |
| Multi-person Pose Estimation | PoseTrack 2017 (val) | mAP (Total)66.5 | 39 | |
| Multi-person pose tracking | PoseTrack 2017 (val) | mAP66.5 | 30 | |
| Multi-person pose tracking | PoseTrack Challenge Leaderboard 2017 (test) | mAP63 | 28 | |
| Pose Estimation and Tracking | PoseTrack 2017 (test) | MOTA51 | 13 | |
| Multi-person Tracking | PoseTrack (val) | HOTA38 | 8 | |
| Multi-person Tracking | MuPoTS-3D (test) | ID Switches49 | 7 | |
| Multi-person Tracking | AVA | ID Count452 | 6 | |
| Pose Tracking | PoseTrack (test) | Tracked IDs Count1.05e+3 | 6 |