MFEN:Multi-Frequency Expert Network for Visible-Infrared Person Re-ID
About
Visible-infrared person re-identification (VI-ReID) is challenging due to the large modality discrepancy between visible and infrared images. We contend that this discrepancy is largely related to differing lighting conditions, including differences in light wavelength and light source type. Recently, frequency-based VI-ReID approaches have achieved notable success because frequency information can better extract identity-relevant contours and details while excluding irrelevant lighting and color. However, existing methods either do not distinguish different frequency bands or focus on only one band, which is insufficient under diverse lighting conditions. To perform comprehensive frequency domain learning, we propose a Multi-Frequency Expert Network (MFEN) that enables multi-frequency modulation and adaptively combines different bands through a mixture-of-experts design. We further introduce Random Frequency Augmentation (RFA) and Frequency Auxiliary Optimization (FAO) to better train MFEN. The three modules are complementary and jointly capture critical frequency-domain details for robust representation learning. Extensive experiments on three VI-ReID datasets demonstrate the effectiveness of our approach.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Visible-Thermal Person Re-identification | RegDB Thermal to Visible | Rank-194.11 | 135 | |
| Visible-Infrared Person Re-Identification | SYSU-MM01 (Indoor Search) | R187.88 | 133 | |
| Visible-Infrared Person Re-Identification | SYSU-MM01 (All Search) | Rank-180.93 | 91 | |
| Visible-Infrared Person Re-Identification | LLCM Infrared2Visible | Rank-1 Acc59 | 28 | |
| Visible-Infrared Person Re-Identification | RegDB Visible to Infrared | Rank-1 Accuracy94.85 | 18 | |
| Person Re-Identification | LLCM Visible to Infrared | R-167.9 | 7 |