Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Graph Convolutional Label Noise Cleaner: Train a Plug-and-play Action Classifier for Anomaly Detection

About

Video anomaly detection under weak labels is formulated as a typical multiple-instance learning problem in previous works. In this paper, we provide a new perspective, i.e., a supervised learning task under noisy labels. In such a viewpoint, as long as cleaning away label noise, we can directly apply fully supervised action classifiers to weakly supervised anomaly detection, and take maximum advantage of these well-developed classifiers. For this purpose, we devise a graph convolutional network to correct noisy labels. Based upon feature similarity and temporal consistency, our network propagates supervisory signals from high-confidence snippets to low-confidence ones. In this manner, the network is capable of providing cleaned supervision for action classifiers. During the test phase, we only need to obtain snippet-wise predictions from the action classifier without any extra post-processing. Extensive experiments on 3 datasets at different scales with 2 types of action classifiers demonstrate the efficacy of our method. Remarkably, we obtain the frame-level AUC score of 82.12% on UCF-Crime.

Jia-Xing Zhong, Nannan Li, Weijie Kong, Shan Liu, Thomas H. Li, Ge Li• 2019

Related benchmarks

TaskDatasetResultRank
Video Anomaly DetectionShanghaiTech (test)
AUC0.8444
194
Abnormal Event DetectionUCSD Ped2 (test)
AUC92.8
146
Abnormal Event DetectionUCSD Ped2
AUC93.2
132
Video Anomaly DetectionUCF-Crime
AUC82.12
129
Video Anomaly DetectionUCF-Crime (test)
AUC82.12
122
Anomaly DetectionUCF-Crime (test)
AUC0.8212
99
Video Anomaly DetectionShanghaiTech--
51
Video Anomaly DetectionShanghaiTech standard (test)
Frame-Level AUC76.44
50
Video Anomaly DetectionUCF-Crime (UCFC) (test)
AUC0.8212
34
Anomaly DetectionShanghaiTech Campus (test)--
22
Showing 10 of 16 rows

Other info

Code

Follow for update