Adversarial Metric Attack and Defense for Person Re-identification
About
Person re-identification (re-ID) has attracted much attention recently due to its great importance in video surveillance. In general, distance metrics used to identify two person images are expected to be robust under various appearance changes. However, our work observes the extreme vulnerability of existing distance metrics to adversarial examples, generated by simply adding human-imperceptible perturbations to person images. Hence, the security danger is dramatically increased when deploying commercial re-ID systems in video surveillance. Although adversarial examples have been extensively applied for classification analysis, it is rarely studied in metric analysis like person re-identification. The most likely reason is the natural gap between the training and testing of re-ID networks, that is, the predictions of a re-ID network cannot be directly used during testing without an effective metric. In this work, we bridge the gap by proposing Adversarial Metric Attack, a parallel methodology to adversarial classification attacks. Comprehensive experiments clearly reveal the adversarial effects in re-ID systems. Meanwhile, we also present an early attempt of training a metric-preserving network, thereby defending the metric against adversarial attacks. At last, by benchmarking various adversarial settings, we expect that our work can facilitate the development of adversarial attack and defense in metric-based applications.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Cross-modality Person Re-identification | SYSU-MM01 (Indoor Search) | Rank-124.85 | 114 | |
| Cross-modality Person Re-identification | RegDB Visible to Thermal (test) | Rank-1 Acc30.86 | 16 | |
| Cross-modality Person Re-identification | RegDB Thermal to Visible (test) | Rank-1 Acc25.83 | 16 | |
| Person Re-Identification | SYSU Visible to Infrared all-search (test) | Rank-1 Accuracy28.36 | 16 | |
| Cross-modality Person Re-identification | LLCM Visible to Infrared (test) | Rank-1 Acc28.48 | 11 | |
| Cross-modality Person Re-identification | LLCM Infrared to Visible (test) | Rank-1 Acc25.64 | 11 |