Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Are pre-trained CNNs good feature extractors for anomaly detection in surveillance videos?

About

Recently, several techniques have been explored to detect unusual behaviour in surveillance videos. Nevertheless, few studies leverage features from pre-trained CNNs and none of then present a comparison of features generate by different models. Motivated by this gap, we compare features extracted by four state-of-the-art image classification networks as a way of describing patches from security video frames. We carry out experiments on the Ped1 and Ped2 datasets and analyze the usage of different feature normalization techniques. Our results indicate that choosing the appropriate normalization is crucial to improve the anomaly detection performance when working with CNN features. Also, in the Ped2 dataset our approach was able to obtain results comparable to the ones of several state-of-the-art methods. Lastly, as our method only considers the appearance of each frame, we believe that it can be combined with approaches that focus on motion patterns to further improve performance.

Tiago S. Nazare, Rodrigo F. de Mello, Moacir A. Ponti• 2018

Related benchmarks

TaskDatasetResultRank
Anomaly DetectionCIFAR-10 32x32x3
AUROC0.8189
87
Anomaly DetectionMVTecAD (test)
Bottle Score99.6
55
Anomaly DetectionMNIST one-class classification
AUROC0.9753
47
Anomaly DetectionMVTec AD
Carpet AUROC81.1
40
Anomaly DetectionMVTec Anomaly Detection 1.0 (test)
PRO (Carpet)0.512
27
Anomaly DetectionMTD
AUROC0.8
15
Anomaly DetectionMTD (test)
AUROC0.978
14
Anomaly DetectionMVTec AD 4 (test)
AUROC (Grid)55.7
11
Anomaly DetectionMagnetic Tile Defects (MTD) (test)
AUROC0.8
7
Showing 9 of 9 rows

Other info

Follow for update