Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-Identification

About

Visible-infrared person re-identification (VI-ReID) is a challenging cross-modality pedestrian retrieval problem. Due to the large intra-class variations and cross-modality discrepancy with large amount of sample noise, it is difficult to learn discriminative part features. Existing VI-ReID methods instead tend to learn global representations, which have limited discriminability and weak robustness to noisy images. In this paper, we propose a novel dynamic dual-attentive aggregation (DDAG) learning method by mining both intra-modality part-level and cross-modality graph-level contextual cues for VI-ReID. We propose an intra-modality weighted-part attention module to extract discriminative part-aggregated features, by imposing the domain knowledge on the part relationship mining. To enhance robustness against noisy samples, we introduce cross-modality graph structured attention to reinforce the representation with the contextual relations across the two modalities. We also develop a parameter-free dynamic dual aggregation learning strategy to adaptively integrate the two components in a progressive joint training manner. Extensive experiments demonstrate that DDAG outperforms the state-of-the-art methods under various settings.

Mang Ye, Jianbing Shen, David J. Crandall, Ling Shao, Jiebo Luo• 2020

Related benchmarks

TaskDatasetResultRank
Cross-modality Person Re-identificationSYSU-MM01 (All Search)
Recall@154.8
142
Visible-Thermal Person Re-identificationRegDB Visible to Thermal
Rank-169.4
140
Visible-Thermal Person Re-identificationRegDB Thermal to Visible
Rank-168.1
117
Cross-modality Person Re-identificationSYSU-MM01 (Indoor Search)
Rank-161.02
114
Visible-Infrared Person Re-IdentificationRegDB Thermal2Visible v1
Rank-1 Acc68.1
87
Visible-Infrared Person Re-IdentificationSYSU-MM01 All Search v1
Rank-154.8
70
RGB-Infrared Cross-Modality Person Re-IdentificationSYSU-MM01 All Search Single-Shot
mAP53.02
51
Visible-to-Infrared Video Person Re-identificationBUPTCampus
Rank-140.4
47
Vehicle Re-identificationMSVR310
mAP23.14
47
Infrared-to-Visible Video Person Re-identificationBUPTCampus
Rank-10.463
47
Showing 10 of 30 rows

Other info

Follow for update