Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-Identification
About
Visible-infrared person re-identification (VI-ReID) is a challenging cross-modality pedestrian retrieval problem. Due to the large intra-class variations and cross-modality discrepancy with large amount of sample noise, it is difficult to learn discriminative part features. Existing VI-ReID methods instead tend to learn global representations, which have limited discriminability and weak robustness to noisy images. In this paper, we propose a novel dynamic dual-attentive aggregation (DDAG) learning method by mining both intra-modality part-level and cross-modality graph-level contextual cues for VI-ReID. We propose an intra-modality weighted-part attention module to extract discriminative part-aggregated features, by imposing the domain knowledge on the part relationship mining. To enhance robustness against noisy samples, we introduce cross-modality graph structured attention to reinforce the representation with the contextual relations across the two modalities. We also develop a parameter-free dynamic dual aggregation learning strategy to adaptively integrate the two components in a progressive joint training manner. Extensive experiments demonstrate that DDAG outperforms the state-of-the-art methods under various settings.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Cross-modality Person Re-identification | SYSU-MM01 (All Search) | Recall@154.8 | 142 | |
| Visible-Thermal Person Re-identification | RegDB Visible to Thermal | Rank-169.4 | 140 | |
| Cross-modality Person Re-identification | SYSU-MM01 (Indoor Search) | Rank-161.02 | 114 | |
| Visible-Infrared Person Re-Identification | RegDB Thermal2Visible v1 | Rank-1 Acc68.1 | 87 | |
| Visible-Thermal Person Re-identification | RegDB Thermal to Visible | Rank-168.1 | 79 | |
| Visible-Infrared Person Re-Identification | SYSU-MM01 All Search v1 | Rank-154.8 | 70 | |
| Vehicle Re-identification | MSVR310 | mAP23.14 | 29 | |
| Visible-Infrared Person Re-Identification | SYSU-MM01 Indoor Search v1 | Rank-161 | 27 | |
| Infrared-to-Visible Video Person Re-identification | BUPTCampus | Rank-10.463 | 18 | |
| Visible-to-Infrared Video Person Re-identification | BUPTCampus | Rank-140.4 | 18 |