Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Selective, Interpretable, and Motion Consistent Privacy Attribute Obfuscation for Action Recognition

About

Concerns for the privacy of individuals captured in public imagery have led to privacy-preserving action recognition. Existing approaches often suffer from issues arising through obfuscation being applied globally and a lack of interpretability. Global obfuscation hides privacy sensitive regions, but also contextual regions important for action recognition. Lack of interpretability erodes trust in these new technologies. We highlight the limitations of current paradigms and propose a solution: Human selected privacy templates that yield interpretability by design, an obfuscation scheme that selectively hides attributes and also induces temporal consistency, which is important in action recognition. Our approach is architecture agnostic and directly modifies input imagery, while existing approaches generally require architecture training. Our approach offers more flexibility, as no retraining is required, and outperforms alternatives on three widely used datasets.

Filip Ilic, He Zhao, Thomas Pock, Richard P. Wildes• 2024

Related benchmarks

TaskDatasetResultRank
Visual Question AnsweringOK-VQA (test)
Accuracy45.1
327
Visual Question AnsweringOK-VQA
Accuracy55.9
260
Action RecognitionUCF101 VISPR
Top-1 Accuracy61.2
24
Action RecognitionHMDB51 VISPR
Top-1 Accuracy48.5
24
Privacy ProtectionUCF101 VISPR
cMAP59.1
12
Privacy ProtectionHMDB51 VISPR
cMAP63.5
12
Privacy ProtectionOK-VQA (test)
cMAP51.5
10
Privacy RecognitionOK-VQA
cMAP51.5
10
Privacy RecognitionVISPR
cMAP54.3
10
Privacy ProtectionVISPR (test)
cMAP54.3
10
Showing 10 of 10 rows

Other info

Follow for update