Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Causal Clothes-Invariant Feature Learning for Cloth-Changing Person Re-ID

About

In cloth-changing person re-identification (CCReID), it is critical to learn clothes-invariant feature, which can provide discriminative ID features that remain robust against clothing changes. However, a spurious correlation currently limits existing ReID methods from effectively extracting these clothing-invariant features. This spurious correlation arises from clothing ownership: clothing is rarely shared across different identities, so models tend to memorize clothing cues for identity recognition, and this strategy generalizes poorly to unseen clothing. In this paper, we propose Causal Clothes-Invariant Learning (CCIL), which explicitly shifts CC-ReID from likelihood learning P (Y|X) to causal intervention learning P (Y|do(X)) to block the clothing shortcut. CCIL realizes this intervention through three modules: a Confounder Dictionary, an Intervention Module, and Disentangle Regularization. The causality-based modeling makes the entire model naturally clothes-invariant, effectively preventing the capture of spurious correlations in feature learning. Extensive experiments validate the effectiveness of CCIL. On PRCC and DeepChange datasets, CCIL achieves Rank-1 accuracies of 66.4% and 59.2%, outperforming state-of-the-art methods by 1.4 and 4.1 percentage points, respectively.

Xulin Li, Yan Lu, Bin Liu, Jiaze Li, Yating Liu, Qi Chu, Mang Ye, Wanli Ouyang, Nenghai Yu• 2023

Related benchmarks

TaskDatasetResultRank
Person Re-IdentificationCUHK03
R114.5
322
Person Re-IdentificationMarket1501
mAP0.2739
143
Person Re-IdentificationPRCC Clothes-Changing
Top-1 Acc71.2
121
Person Re-IdentificationLTCC cloth-changing
Rank-146
97
Person Re-IdentificationVC-Clothes (CC)
Top-1 Acc91
60
Person Re-IdentificationPRCC
Rank1 Acc42.7
41
Person Re-IdentificationLTCC
Rank-1 Acc24.49
36
Person Re-IdentificationCeleb-reID light
Rank-138.5
19
Person Re-IdentificationSYSU-MM01
mAP18.82
15
Person Re-IdentificationLaST
Top-1 Accuracy76.8
14
Showing 10 of 22 rows

Other info

Follow for update