Activity-Biometrics: Person Identification from Daily Activities
About
In this work, we study a novel problem which focuses on person identification while performing daily activities. Learning biometric features from RGB videos is challenging due to spatio-temporal complexity and presence of appearance biases such as clothing color and background. We propose ABNet, a novel framework which leverages disentanglement of biometric and non-biometric features to perform effective person identification from daily activities. ABNet relies on a bias-less teacher to learn biometric features from RGB videos and explicitly disentangle non-biometric features with the help of biometric distortion. In addition, ABNet also exploits activity prior for biometrics which is enabled by joint biometric and activity learning. We perform comprehensive evaluation of the proposed approach across five different datasets which are derived from existing activity recognition benchmarks. Furthermore, we extensively compare ABNet with existing works in person identification and demonstrate its effectiveness for activity-based biometrics across all five datasets. The code and dataset can be accessed at: \url{https://github.com/sacrcv/Activity-Biometrics/}
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Person Identification | NTU RGB-AB View+ (same-activity) | Rank-1 Acc78.76 | 15 | |
| Person Identification | PKU MMD-AB View+ (same-activity) | Rank-1 Acc86.83 | 15 | |
| Person Identification | Charades-AB (same-activity) | Rank 145.84 | 15 | |
| Person Identification | ACC-MM1-Activities (same-activity) | Rank-1 Acc80.43 | 15 | |
| Person Identification | BRIAR-BGC3 | R@134.38 | 7 | |
| Person Identification | NTU RGB-AB View+ (cross-activity) | Rank-1 Acc77.01 | 1 | |
| Person Identification | PKU MMD-AB cross-activity View+ | Rank-1 Acc81.44 | 1 | |
| Person Identification | Charades-AB cross-activity View+ | Rank 144.82 | 1 | |
| Person Identification | ACC-MMI-Activities View+ (cross-activity) | Rank-1 Acc68.31 | 1 |