Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

EgoBlur: Responsible Innovation in Aria

About

Project Aria pushes the frontiers of Egocentric AI with large-scale real-world data collection using purposely designed glasses with privacy first approach. To protect the privacy of bystanders being recorded by the glasses, our research protocols are designed to ensure recorded video is processed by an AI anonymization model that removes bystander faces and vehicle license plates. Detected face and license plate regions are processed with a Gaussian blur such that these personal identification information (PII) regions are obscured. This process helps to ensure that anonymized versions of the video is retained for research purposes. In Project Aria, we have developed a state-of-the-art anonymization system EgoBlur. In this paper, we present extensive analysis of EgoBlur on challenging datasets comparing its performance with other state-of-the-art systems from industry and academia including extensive Responsible AI analysis on recently released Casual Conversations V2 dataset.

Nikhil Raina, Guruprasad Somasundaram, Kang Zheng, Sagar Miglani, Steve Saarinen, Jeff Meissner, Mark Schwesinger, Luis Pesqueira, Ishita Prasad, Edward Miller, Prince Gupta, Mingfei Yan, Richard Newcombe, Carl Ren, Omkar M Parkhi• 2023

Related benchmarks

TaskDatasetResultRank
Person Re-IdentificationCCVID Clothes-Changing
R-186.6
40
Video Question AnsweringNExT-QA zero-shot
Accuracy0.7756
28
Video Question AnsweringHOIGen zero-shot
Accuracy86.9
11
Video Question AnsweringMedVideoCap zero-shot
Accuracy (%)90.6
11
Video Quality EvaluationHOIGen 1M (test)
Subject Consistency92.18
10
Privacy EvaluationHOI-Gen1M
Identity Similarity0.14
10
Body Re-identificationCCVID Standard (SC)
R-1100
9
Showing 7 of 7 rows

Other info

Follow for update