Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Identity-Guided Human Semantic Parsing for Person Re-Identification

About

Existing alignment-based methods have to employ the pretrained human parsing models to achieve the pixel-level alignment, and cannot identify the personal belongings (e.g., backpacks and reticule) which are crucial to person re-ID. In this paper, we propose the identity-guided human semantic parsing approach (ISP) to locate both the human body parts and personal belongings at pixel-level for aligned person re-ID only with person identity labels. We design the cascaded clustering on feature maps to generate the pseudo-labels of human parts. Specifically, for the pixels of all images of a person, we first group them to foreground or background and then group the foreground pixels to human parts. The cluster assignments are subsequently used as pseudo-labels of human parts to supervise the part estimation and ISP iteratively learns the feature maps and groups them. Finally, local features of both human body parts and personal belongings are obtained according to the selflearned part estimation, and only features of visible parts are utilized for the retrieval. Extensive experiments on three widely used datasets validate the superiority of ISP over lots of state-of-the-art methods. Our code is available at https://github.com/CASIA-IVA-Lab/ISP-reID.

Kuan Zhu, Haiyun Guo, Zhiwei Liu, Ming Tang, Jinqiao Wang• 2020

Related benchmarks

TaskDatasetResultRank
Person Re-IdentificationMarket1501 (test)
Rank-1 Accuracy95.3
1264
Person Re-IdentificationDuke MTMC-reID (test)
Rank-189.6
1018
Person Re-IdentificationMarket 1501
mAP88.6
999
Person Re-IdentificationDukeMTMC-reID
Rank-1 Acc89.6
648
Person Re-IdentificationMarket-1501 (test)
Rank-195.3
384
Person Re-IdentificationCUHK03 (Detected)
Rank-1 Accuracy75.2
219
Person Re-IdentificationCUHK03
R175.2
184
Person Re-IdentificationCUHK03 (Labeled)
Rank-1 Rate76.5
180
Person Re-IdentificationOccluded-Duke (test)
Rank-1 Acc62.8
177
Person Re-IdentificationDukeMTMC
R1 Accuracy89.6
120
Showing 10 of 30 rows

Other info

Code

Follow for update