Implicit Discriminative Knowledge Learning for Visible-Infrared Person Re-Identification
About
Visible-Infrared Person Re-identification (VI-ReID) is a challenging cross-modal pedestrian retrieval task, due to significant intra-class variations and cross-modal discrepancies among different cameras. Existing works mainly focus on embedding images of different modalities into a unified space to mine modality-shared features. They only seek distinctive information within these shared features, while ignoring the identity-aware useful information that is implicit in the modality-specific features. To address this issue, we propose a novel Implicit Discriminative Knowledge Learning (IDKL) network to uncover and leverage the implicit discriminative information contained within the modality-specific. First, we extract modality-specific and modality-shared features using a novel dual-stream network. Then, the modality-specific features undergo purification to reduce their modality style discrepancies while preserving identity-aware discriminative knowledge. Subsequently, this kind of implicit knowledge is distilled into the modality-shared feature to enhance its distinctiveness. Finally, an alignment loss is proposed to minimize modality discrepancy on enhanced modality-shared features. Extensive experiments on multiple public datasets demonstrate the superiority of IDKL network over the state-of-the-art methods. Code is available at https://github.com/1KK077/IDKL.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Visible-Infrared Person Re-Identification | SYSU-MM01 (Indoor Search) | R194.3 | 115 | |
| Visible-Infrared Person Re-Identification | SYSU-MM01 (All Search) | Rank-184.34 | 73 | |
| Person Re-Identification | SYSU-CMCC Infrared to Visible | Rank-121.3 | 15 | |
| Person Re-Identification | SYSU-CMCC Visible to Infrared | Rank-122.4 | 15 | |
| Person Re-Identification | RegDB Infrared2Visible | Rank-1 Accuracy94.22 | 11 | |
| Person Re-Identification | RegDB Visible2Infrared | Rank-1 Accuracy94.72 | 11 |