PartMix: Regularization Strategy to Learn Part Discovery for Visible-Infrared Person Re-identification
About
Modern data augmentation using a mixture-based technique can regularize the models from overfitting to the training data in various computer vision applications, but a proper data augmentation technique tailored for the part-based Visible-Infrared person Re-IDentification (VI-ReID) models remains unexplored. In this paper, we present a novel data augmentation technique, dubbed PartMix, that synthesizes the augmented samples by mixing the part descriptors across the modalities to improve the performance of part-based VI-ReID models. Especially, we synthesize the positive and negative samples within the same and across different identities and regularize the backbone model through contrastive learning. In addition, we also present an entropy-based mining strategy to weaken the adverse impact of unreliable positive and negative samples. When incorporated into existing part-based VI-ReID model, PartMix consistently boosts the performance. We conduct experiments to demonstrate the effectiveness of our PartMix over the existing VI-ReID methods and provide ablation studies.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Cross-modality Person Re-identification | SYSU-MM01 (All Search) | Recall@177.78 | 142 | |
| Visible-Thermal Person Re-identification | RegDB Visible to Thermal | Rank-185.7 | 140 | |
| Cross-modality Person Re-identification | SYSU-MM01 (Indoor Search) | Rank-181.52 | 114 | |
| Visible-Infrared Person Re-Identification | RegDB Thermal2Visible v1 | Rank-1 Acc85.66 | 87 | |
| Visible-Thermal Person Re-identification | RegDB Thermal to Visible | Rank-184.93 | 79 | |
| Visible-Infrared Person Re-Identification | SYSU-MM01 All Search v1 | Rank-180.54 | 70 | |
| Visible-Infrared Person Re-Identification | SYSU-MM01 (Indoor Search) | R187.99 | 42 | |
| RGB-Infrared Cross-Modality Person Re-Identification | SYSU-MM01 All Search Single-Shot | mAP74.62 | 34 | |
| Visible-Infrared Person Re-Identification | SYSU-MM01 Indoor Search v1 | Rank-181.5 | 27 | |
| RGB-Infrared Cross-Modality Person Re-Identification | SYSU-MM01 Indoor-Search Single-Shot | mAP84.38 | 22 |