Selective, Interpretable, and Motion Consistent Privacy Attribute Obfuscation for Action Recognition
About
Concerns for the privacy of individuals captured in public imagery have led to privacy-preserving action recognition. Existing approaches often suffer from issues arising through obfuscation being applied globally and a lack of interpretability. Global obfuscation hides privacy sensitive regions, but also contextual regions important for action recognition. Lack of interpretability erodes trust in these new technologies. We highlight the limitations of current paradigms and propose a solution: Human selected privacy templates that yield interpretability by design, an obfuscation scheme that selectively hides attributes and also induces temporal consistency, which is important in action recognition. Our approach is architecture agnostic and directly modifies input imagery, while existing approaches generally require architecture training. Our approach offers more flexibility, as no retraining is required, and outperforms alternatives on three widely used datasets.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Visual Question Answering | OK-VQA (test) | Accuracy45.1 | 327 | |
| Visual Question Answering | OK-VQA | Accuracy55.9 | 260 | |
| Action Recognition | UCF101 VISPR | Top-1 Accuracy61.2 | 24 | |
| Action Recognition | HMDB51 VISPR | Top-1 Accuracy48.5 | 24 | |
| Privacy Protection | UCF101 VISPR | cMAP59.1 | 12 | |
| Privacy Protection | HMDB51 VISPR | cMAP63.5 | 12 | |
| Privacy Protection | OK-VQA (test) | cMAP51.5 | 10 | |
| Privacy Recognition | OK-VQA | cMAP51.5 | 10 | |
| Privacy Recognition | VISPR | cMAP54.3 | 10 | |
| Privacy Protection | VISPR (test) | cMAP54.3 | 10 |