Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Semi-Supervised 2D Human Pose Estimation Driven by Position Inconsistency Pseudo Label Correction Module

About

In this paper, we delve into semi-supervised 2D human pose estimation. The previous method ignored two problems: (i) When conducting interactive training between large model and lightweight model, the pseudo label of lightweight model will be used to guide large models. (ii) The negative impact of noise pseudo labels on training. Moreover, the labels used for 2D human pose estimation are relatively complex: keypoint category and keypoint position. To solve the problems mentioned above, we propose a semi-supervised 2D human pose estimation framework driven by a position inconsistency pseudo label correction module (SSPCM). We introduce an additional auxiliary teacher and use the pseudo labels generated by the two teacher model in different periods to calculate the inconsistency score and remove outliers. Then, the two teacher models are updated through interactive training, and the student model is updated using the pseudo labels generated by two teachers. To further improve the performance of the student model, we use the semi-supervised Cut-Occlude based on pseudo keypoint perception to generate more hard and effective samples. In addition, we also proposed a new indoor overhead fisheye human keypoint dataset WEPDTOF-Pose. Extensive experiments demonstrate that our method outperforms the previous best semi-supervised 2D human pose estimation method. We will release the code and dataset at https://github.com/hlz0606/SSPCM.

Linzhi Huang, Yulong Li, Hongbo Tian, Yue Yang, Xiangang Li, Weihong Deng, Jieping Ye• 2023

Related benchmarks

TaskDatasetResultRank
Human Pose EstimationCOCO (test-dev)
AP77.5
408
2D Human Pose EstimationCOCO 2017 (val)
AP60.7
386
Human Pose EstimationMPII (test)
Shoulder PCK97.5
314
Human Pose EstimationCOCO (val)
AP79.4
53
2D Human Pose EstimationWEPDTOF-Pose (test)
AP59.1
7
2D Human Pose EstimationBKFisheye (test)
AP68.7
4
Showing 6 of 6 rows

Other info

Code

Follow for update