Robust Re-Identification by Multiple Views Knowledge Distillation
About
To achieve robustness in Re-Identification, standard methods leverage tracking information in a Video-To-Video fashion. However, these solutions face a large drop in performance for single image queries (e.g., Image-To-Video setting). Recent works address this severe degradation by transferring temporal information from a Video-based network to an Image-based one. In this work, we devise a training strategy that allows the transfer of a superior knowledge, arising from a set of views depicting the target object. Our proposal - Views Knowledge Distillation (VKD) - pins this visual variety as a supervision signal within a teacher-student framework, where the teacher educates a student who observes fewer views. As a result, the student outperforms not only its teacher but also the current state-of-the-art in Image-To-Video by a wide margin (6.3% mAP on MARS, 8.6% on Duke-Video-ReId and 5% on VeRi-776). A thorough analysis - on Person, Vehicle and Animal Re-ID - investigates the properties of VKD from a qualitatively and quantitatively perspective. Code is available at https://github.com/aimagelab/VKD.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Vehicle Re-identification | VeRi-776 (test) | Rank-195.7 | 232 | |
| Video-to-Video Person Re-identification | MARS (test) | Top-1 Accuracy89.4 | 22 | |
| Image-to-Video Person Re-identification | DukeMTMC-VideoReID (test) | Top-1 Acc86.2 | 16 | |
| Person Identification | PKU MMD-AB View+ (same-activity) | Rank-1 Acc78.35 | 15 | |
| Person Identification | Charades-AB (same-activity) | Rank 136.31 | 15 | |
| Person Identification | NTU RGB-AB View+ (same-activity) | Rank-1 Acc67.41 | 15 | |
| Person Identification | ACC-MM1-Activities (same-activity) | Rank-1 Acc55.38 | 15 | |
| Video-to-shop retrieval | MultiDeepFashion 2 (test) | T-1 Accuracy21 | 13 | |
| Image-to-Video Person Re-identification | MARS (test) | Top-1 Acc84.3 | 9 | |
| Image-to-Video Vehicle Re-identification | VeRi-776 (test) | Top-1 Acc95.7 | 9 |