Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Activity-Biometrics: Person Identification from Daily Activities

About

In this work, we study a novel problem which focuses on person identification while performing daily activities. Learning biometric features from RGB videos is challenging due to spatio-temporal complexity and presence of appearance biases such as clothing color and background. We propose ABNet, a novel framework which leverages disentanglement of biometric and non-biometric features to perform effective person identification from daily activities. ABNet relies on a bias-less teacher to learn biometric features from RGB videos and explicitly disentangle non-biometric features with the help of biometric distortion. In addition, ABNet also exploits activity prior for biometrics which is enabled by joint biometric and activity learning. We perform comprehensive evaluation of the proposed approach across five different datasets which are derived from existing activity recognition benchmarks. Furthermore, we extensively compare ABNet with existing works in person identification and demonstrate its effectiveness for activity-based biometrics across all five datasets. The code and dataset can be accessed at: \url{https://github.com/sacrcv/Activity-Biometrics/}

Shehreen Azad, Yogesh Singh Rawat• 2024

Related benchmarks

TaskDatasetResultRank
Person IdentificationNTU RGB-AB View+ (same-activity)
Rank-1 Acc78.76
15
Person IdentificationPKU MMD-AB View+ (same-activity)
Rank-1 Acc86.83
15
Person IdentificationCharades-AB (same-activity)
Rank 145.84
15
Person IdentificationACC-MM1-Activities (same-activity)
Rank-1 Acc80.43
15
Person IdentificationBRIAR-BGC3
R@134.38
7
Person IdentificationNTU RGB-AB View+ (cross-activity)
Rank-1 Acc77.01
1
Person IdentificationPKU MMD-AB cross-activity View+
Rank-1 Acc81.44
1
Person IdentificationCharades-AB cross-activity View+
Rank 144.82
1
Person IdentificationACC-MMI-Activities View+ (cross-activity)
Rank-1 Acc68.31
1
Showing 9 of 9 rows

Other info

Code

Follow for update