Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Robust Re-Identification by Multiple Views Knowledge Distillation

About

To achieve robustness in Re-Identification, standard methods leverage tracking information in a Video-To-Video fashion. However, these solutions face a large drop in performance for single image queries (e.g., Image-To-Video setting). Recent works address this severe degradation by transferring temporal information from a Video-based network to an Image-based one. In this work, we devise a training strategy that allows the transfer of a superior knowledge, arising from a set of views depicting the target object. Our proposal - Views Knowledge Distillation (VKD) - pins this visual variety as a supervision signal within a teacher-student framework, where the teacher educates a student who observes fewer views. As a result, the student outperforms not only its teacher but also the current state-of-the-art in Image-To-Video by a wide margin (6.3% mAP on MARS, 8.6% on Duke-Video-ReId and 5% on VeRi-776). A thorough analysis - on Person, Vehicle and Animal Re-ID - investigates the properties of VKD from a qualitatively and quantitatively perspective. Code is available at https://github.com/aimagelab/VKD.

Angelo Porrello, Luca Bergamini, Simone Calderara• 2020

Related benchmarks

TaskDatasetResultRank
Vehicle Re-identificationVeRi-776 (test)
Rank-195.7
232
Video-to-Video Person Re-identificationMARS (test)
Top-1 Accuracy89.4
22
Image-to-Video Person Re-identificationDukeMTMC-VideoReID (test)
Top-1 Acc86.2
16
Person IdentificationPKU MMD-AB View+ (same-activity)
Rank-1 Acc78.35
15
Person IdentificationCharades-AB (same-activity)
Rank 136.31
15
Person IdentificationNTU RGB-AB View+ (same-activity)
Rank-1 Acc67.41
15
Person IdentificationACC-MM1-Activities (same-activity)
Rank-1 Acc55.38
15
Video-to-shop retrievalMultiDeepFashion 2 (test)
T-1 Accuracy21
13
Image-to-Video Person Re-identificationMARS (test)
Top-1 Acc84.3
9
Image-to-Video Vehicle Re-identificationVeRi-776 (test)
Top-1 Acc95.7
9
Showing 10 of 15 rows

Other info

Code

Follow for update