Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Graph Convolutional Label Noise Cleaner: Train a Plug-and-play Action Classifier for Anomaly Detection

About

Video anomaly detection under weak labels is formulated as a typical multiple-instance learning problem in previous works. In this paper, we provide a new perspective, i.e., a supervised learning task under noisy labels. In such a viewpoint, as long as cleaning away label noise, we can directly apply fully supervised action classifiers to weakly supervised anomaly detection, and take maximum advantage of these well-developed classifiers. For this purpose, we devise a graph convolutional network to correct noisy labels. Based upon feature similarity and temporal consistency, our network propagates supervisory signals from high-confidence snippets to low-confidence ones. In this manner, the network is capable of providing cleaned supervision for action classifiers. During the test phase, we only need to obtain snippet-wise predictions from the action classifier without any extra post-processing. Extensive experiments on 3 datasets at different scales with 2 types of action classifiers demonstrate the efficacy of our method. Remarkably, we obtain the frame-level AUC score of 82.12% on UCF-Crime.

Jia-Xing Zhong, Nannan Li, Weijie Kong, Shan Liu, Thomas H. Li, Ge Li• 2019

Related benchmarks

TaskDatasetResultRank
Video Anomaly DetectionUCF-Crime
AUC82.12
218
Video Anomaly DetectionShanghaiTech (test)
AUC0.8444
211
Abnormal Event DetectionUCSD Ped2
AUC93.2
150
Abnormal Event DetectionUCSD Ped2 (test)
AUC92.8
146
Video Anomaly DetectionUCF-Crime (test)
AUC82.12
122
Anomaly DetectionUCF-Crime (test)
AUC0.8212
109
Video Anomaly DetectionShanghaiTech--
51
Video Anomaly DetectionShanghaiTech standard (test)
Frame-Level AUC76.44
50
Video Anomaly DetectionUCF-Crime (UCFC) (test)
AUC0.8212
34
Anomaly DetectionShanghaiTech Campus (test)--
22
Showing 10 of 16 rows

Other info

Code

Follow for update