Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

PartMix: Regularization Strategy to Learn Part Discovery for Visible-Infrared Person Re-identification

About

Modern data augmentation using a mixture-based technique can regularize the models from overfitting to the training data in various computer vision applications, but a proper data augmentation technique tailored for the part-based Visible-Infrared person Re-IDentification (VI-ReID) models remains unexplored. In this paper, we present a novel data augmentation technique, dubbed PartMix, that synthesizes the augmented samples by mixing the part descriptors across the modalities to improve the performance of part-based VI-ReID models. Especially, we synthesize the positive and negative samples within the same and across different identities and regularize the backbone model through contrastive learning. In addition, we also present an entropy-based mining strategy to weaken the adverse impact of unreliable positive and negative samples. When incorporated into existing part-based VI-ReID model, PartMix consistently boosts the performance. We conduct experiments to demonstrate the effectiveness of our PartMix over the existing VI-ReID methods and provide ablation studies.

Minsu Kim, Seungryong Kim, JungIn Park, Seongheon Park, Kwanghoon Sohn• 2023

Related benchmarks

TaskDatasetResultRank
Cross-modality Person Re-identificationSYSU-MM01 (All Search)
Recall@177.78
142
Visible-Thermal Person Re-identificationRegDB Visible to Thermal
Rank-185.7
140
Cross-modality Person Re-identificationSYSU-MM01 (Indoor Search)
Rank-181.52
114
Visible-Infrared Person Re-IdentificationRegDB Thermal2Visible v1
Rank-1 Acc85.66
87
Visible-Thermal Person Re-identificationRegDB Thermal to Visible
Rank-184.93
79
Visible-Infrared Person Re-IdentificationSYSU-MM01 All Search v1
Rank-180.54
70
Visible-Infrared Person Re-IdentificationSYSU-MM01 (Indoor Search)
R187.99
42
RGB-Infrared Cross-Modality Person Re-IdentificationSYSU-MM01 All Search Single-Shot
mAP74.62
34
Visible-Infrared Person Re-IdentificationSYSU-MM01 Indoor Search v1
Rank-181.5
27
RGB-Infrared Cross-Modality Person Re-IdentificationSYSU-MM01 Indoor-Search Single-Shot
mAP84.38
22
Showing 10 of 12 rows

Other info

Follow for update