Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

BiCnet-TKS: Learning Efficient Spatial-Temporal Representation for Video Person Re-Identification

About

In this paper, we present an efficient spatial-temporal representation for video person re-identification (reID). Firstly, we propose a Bilateral Complementary Network (BiCnet) for spatial complementarity modeling. Specifically, BiCnet contains two branches. Detail Branch processes frames at original resolution to preserve the detailed visual clues, and Context Branch with a down-sampling strategy is employed to capture long-range contexts. On each branch, BiCnet appends multiple parallel and diverse attention modules to discover divergent body parts for consecutive frames, so as to obtain an integral characteristic of target identity. Furthermore, a Temporal Kernel Selection (TKS) block is designed to capture short-term as well as long-term temporal relations by an adaptive mode. TKS can be inserted into BiCnet at any depth to construct BiCnetTKS for spatial-temporal modeling. Experimental results on multiple benchmarks show that BiCnet-TKS outperforms state-of-the-arts with about 50% less computations. The source code is available at https://github.com/ blue-blue272/BiCnet-TKS.

Ruibing Hou, Hong Chang, Bingpeng Ma, Rui Huang, Shiguang Shan• 2021

Related benchmarks

TaskDatasetResultRank
Video Person Re-IDMARS
Rank-1 Acc90.2
106
Video Person Re-IdentificationG2A-VReID Ground to Aerial
mAP63.4
25
Video Person Re-IdentificationAG-VPReID Aerial to Ground
mAP59.8
20
Person IdentificationNTU RGB-AB View+ (same-activity)
Rank-1 Acc72.71
15
Person IdentificationPKU MMD-AB View+ (same-activity)
Rank-1 Acc80.79
15
Person IdentificationCharades-AB (same-activity)
Rank 140.31
15
Person IdentificationACC-MM1-Activities (same-activity)
Rank-1 Acc60.44
15
Video Person Re-IdentificationLS-VID Ground to Ground
mAP75.1
14
Person Re-IdentificationDetReIDX G→A v1
mAP22.12
11
Person Re-IdentificationDetReIDX A→G v1
mAP33.28
11
Showing 10 of 11 rows

Other info

Follow for update