Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

BIT: Matching-based Bi-directional Interaction Transformation Network for Visible-Infrared Person Re-Identification

About

Visible-Infrared Person Re-Identification (VI-ReID) is a challenging retrieval task due to the substantial modality gap between visible and infrared images. While existing methods attempt to bridge this gap by learning modality-invariant features within a shared embedding space, they often overlook the complex and implicit correlations between modalities. This limitation becomes more severe under distribution shifts, where infrared samples are often far fewer than visible ones. To address these challenges, we propose a novel network termed Bi-directional Interaction Transformation (BIT). Instead of relying on rigid feature alignment, BIT adopts a matching-based strategy that explicitly models the interaction between visible and infrared image pairs. Specifically, BIT employs an encoder-decoder architecture where the encoder extracts preliminary feature representations, and the decoder performs bi-directional feature integration and query aware scoring to enhance cross-modality correspondence. To our best knowledge, BIT is the first to introduce such pairwise matching-driven interaction in VI-ReID. Extensive experiments on several benchmarks demonstrate that our BIT achieves state-of-the-art performance, highlighting its effectiveness in the VI-ReID task.

Haoxuan Xu, Guanglin Niu• 2026

Related benchmarks

TaskDatasetResultRank
Visible-Infrared Person Re-IdentificationSYSU-MM01 (Indoor Search)
R195.74
115
Visible-Infrared Person Re-IdentificationSYSU-MM01 (All Search)
Rank-187.31
73
Visible-Infrared Person Re-IdentificationLLCM Infrared2Visible
Rank-1 Acc66.7
21
Cross-modality Person Re-identificationLLCM Visible to Infrared (test)
Rank-1 Acc73.1
16
Person Re-IdentificationRegDB Visible2Infrared
Rank-1 Accuracy96.12
11
Person Re-IdentificationRegDB Infrared2Visible
Rank-1 Accuracy93.65
11
Showing 6 of 6 rows

Other info

Follow for update