Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Parameter Sharing Exploration and Hetero-Center based Triplet Loss for Visible-Thermal Person Re-Identification

About

This paper focuses on the visible-thermal cross-modality person re-identification (VT Re-ID) task, whose goal is to match person images between the daytime visible modality and the nighttime thermal modality. The two-stream network is usually adopted to address the cross-modality discrepancy, the most challenging problem for VT Re-ID, by learning the multi-modality person features. In this paper, we explore how many parameters of two-stream network should share, which is still not well investigated in the existing literature. By well splitting the ResNet50 model to construct the modality-specific feature extracting network and modality-sharing feature embedding network, we experimentally demonstrate the effect of parameters sharing of two-stream network for VT Re-ID. Moreover, in the framework of part-level person feature learning, we propose the hetero-center based triplet loss to relax the strict constraint of traditional triplet loss through replacing the comparison of anchor to all the other samples by anchor center to all the other centers. With the extremely simple means, the proposed method can significantly improve the VT Re-ID performance. The experimental results on two datasets show that our proposed method distinctly outperforms the state-of-the-art methods by large margins, especially on RegDB dataset achieving superior performance, rank1/mAP/mINP 91.05%/83.28%/68.84%. It can be a new baseline for VT Re-ID, with a simple but effective strategy.

Haijun Liu, Xiaoheng Tan, Xichuan Zhou• 2020

Related benchmarks

TaskDatasetResultRank
Cross-modality Person Re-identificationSYSU-MM01 (All Search)
Recall@161.68
142
Visible-Thermal Person Re-identificationRegDB Visible to Thermal
Rank-191.05
140
Cross-modality Person Re-identificationSYSU-MM01 (Indoor Search)
Rank-163.41
114
Visible-Thermal Person Re-identificationRegDB Thermal to Visible
Rank-189.3
79
Ship Re-identificationHOSS-ReID SAR to Optical
mAP10.9
19
Ship Re-identificationHOSS-ReID (All)
mAP34
19
Ship Re-identificationHOSS-ReID Optical to SAR
mAP11.1
19
Showing 7 of 7 rows

Other info

Code

Follow for update