Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Cross-Platform Video Person ReID: A New Benchmark Dataset and Adaptation Approach

About

In this paper, we construct a large-scale benchmark dataset for Ground-to-Aerial Video-based person Re-Identification, named G2A-VReID, which comprises 185,907 images and 5,576 tracklets, featuring 2,788 distinct identities. To our knowledge, this is the first dataset for video ReID under Ground-to-Aerial scenarios. G2A-VReID dataset has the following characteristics: 1) Drastic view changes; 2) Large number of annotated identities; 3) Rich outdoor scenarios; 4) Huge difference in resolution. Additionally, we propose a new benchmark approach for cross-platform ReID by transforming the cross-platform visual alignment problem into visual-semantic alignment through vision-language model (i.e., CLIP) and applying a parameter-efficient Video Set-Level-Adapter module to adapt image-based foundation model to video ReID tasks, termed VSLA-CLIP. Besides, to further reduce the great discrepancy across the platforms, we also devise the platform-bridge prompts for efficient visual feature alignment. Extensive experiments demonstrate the superiority of the proposed method on all existing video ReID datasets and our proposed G2A-VReID dataset.

Shizhou Zhang, Wenlong Luo, De Cheng, Qingchun Yang, Lingyan Ran, Yinghui Xing, Yanning Zhang• 2024

Related benchmarks

TaskDatasetResultRank
Video Person Re-IdentificationMARS v1 (test)
mAP88.2
41
Video-based Person Re-identificationiLIDS-VID v1 (test)
Rank-1 Accuracy95.3
18
Video-based Person Re-identificationDanceVReID v1 (test)
mAP52.5
14
Video-based Person Re-identificationSportsVReID v1 (test)
mAP74.4
13
Person Re-IdentificationDetReIDX A→G v1
mAP41.63
11
Person Re-IdentificationDetReIDX G→A v1
mAP26.26
11
Person Re-IdentificationDetReIDX A→A v1
mAP13.83
11
Vehicle Re-identificationDetReIDX V1
mAP-328.11
9
Vehicle Re-identificationVReID-XFD A→A
Rank-1 (R1)15.96
6
Vehicle Re-identificationVReID-XFD A→G
Rank-1 Accuracy28.96
6
Showing 10 of 14 rows

Other info

Follow for update