Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-Identification

About

Visible-infrared person re-identification (VI-ReID) is a challenging cross-modality pedestrian retrieval problem. Due to the large intra-class variations and cross-modality discrepancy with large amount of sample noise, it is difficult to learn discriminative part features. Existing VI-ReID methods instead tend to learn global representations, which have limited discriminability and weak robustness to noisy images. In this paper, we propose a novel dynamic dual-attentive aggregation (DDAG) learning method by mining both intra-modality part-level and cross-modality graph-level contextual cues for VI-ReID. We propose an intra-modality weighted-part attention module to extract discriminative part-aggregated features, by imposing the domain knowledge on the part relationship mining. To enhance robustness against noisy samples, we introduce cross-modality graph structured attention to reinforce the representation with the contextual relations across the two modalities. We also develop a parameter-free dynamic dual aggregation learning strategy to adaptively integrate the two components in a progressive joint training manner. Extensive experiments demonstrate that DDAG outperforms the state-of-the-art methods under various settings.

Mang Ye, Jianbing Shen, David J. Crandall, Ling Shao, Jiebo Luo• 2020

Related benchmarks

TaskDatasetResultRank
Cross-modality Person Re-identificationSYSU-MM01 (All Search)
Recall@154.8
142
Visible-Thermal Person Re-identificationRegDB Visible to Thermal
Rank-169.4
140
Cross-modality Person Re-identificationSYSU-MM01 (Indoor Search)
Rank-161.02
114
Visible-Infrared Person Re-IdentificationRegDB Thermal2Visible v1
Rank-1 Acc68.1
87
Visible-Thermal Person Re-identificationRegDB Thermal to Visible
Rank-168.1
79
Visible-Infrared Person Re-IdentificationSYSU-MM01 All Search v1
Rank-154.8
70
Vehicle Re-identificationMSVR310
mAP23.14
29
Visible-Infrared Person Re-IdentificationSYSU-MM01 Indoor Search v1
Rank-161
27
Infrared-to-Visible Video Person Re-identificationBUPTCampus
Rank-10.463
18
Visible-to-Infrared Video Person Re-identificationBUPTCampus
Rank-140.4
18
Showing 10 of 19 rows

Other info

Follow for update