Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Deep Multi-Task Networks For Occluded Pedestrian Pose Estimation

About

Most of the existing works on pedestrian pose estimation do not consider estimating the pose of an occluded pedestrian, as the annotations of the occluded parts are not available in relevant automotive datasets. For example, CityPersons, a well-known dataset for pedestrian detection in automotive scenes does not provide pose annotations, whereas MS-COCO, a non-automotive dataset, contains human pose estimation. In this work, we propose a multi-task framework to extract pedestrian features through detection and instance segmentation tasks performed separately on these two distributions. Thereafter, an encoder learns pose specific features using an unsupervised instance-level domain adaptation method for the pedestrian instances from both distributions. The proposed framework has improved state-of-the-art performances of pose estimation, pedestrian detection, and instance segmentation.

Arindam Das, Sudip Das, Ganesh Sistu, Jonathan Horgan, Ujjwal Bhattacharya, Edward Jones, Martin Glavin, Ciar\'an Eising• 2022

Related benchmarks

TaskDatasetResultRank
Pedestrian DetectionCityPersons (val)
AP (Reasonable)12.01
85
Pedestrian Pose EstimationMS-COCO
AP75.7
5
Instance SegmentationCityPersons (val)
AP (Person)42.7
4
Pedestrian Pose EstimationMS-COCO 20% Occlusion (test)
AP92
3
Pedestrian Pose EstimationMS-COCO 30% Occlusion (test)
AP85.9
3
Pedestrian Pose EstimationMS-COCO 40% Occlusion (test)
AP82.4
3
Pedestrian Pose EstimationMS-COCO 50% Occlusion (test)
AP75.3
3
Pedestrian Pose EstimationMS-COCO 60% Occlusion (test)
AP65.7
3
Pedestrian Pose EstimationMS-COCO 70% Occlusion (test)
AP59.3
3
Showing 9 of 9 rows

Other info

Follow for update