Plug-and-Play CNN for Crowd Motion Analysis: An Application in Abnormal Event Detection
About
Most of the crowd abnormal event detection methods rely on complex hand-crafted features to represent the crowd motion and appearance. Convolutional Neural Networks (CNN) have shown to be a powerful tool with excellent representational capacities, which can leverage the need for hand-crafted features. In this paper, we show that keeping track of the changes in the CNN feature across time can facilitate capturing the local abnormality. We specifically propose a novel measure-based method which allows measuring the local abnormality in a video by combining semantic information (inherited from existing CNN models) with low-level Optical-Flow. One of the advantage of this method is that it can be used without the fine-tuning costs. The proposed method is validated on challenging abnormality detection datasets and the results show the superiority of our method compared to the state-of-the-art methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Abnormal Event Detection | UCSD Ped2 (test) | AUC88.4 | 146 | |
| Abnormal Event Detection | UCSD Ped2 | AUC93.5 | 132 | |
| Abnormal Event Detection | UCSD Ped1 | AUC0.957 | 28 | |
| Abnormal Event Detection | UMN dataset | Frame AUC (All Scenes)98 | 25 | |
| Abnormal Event Detection | UMN Unusual Crowd Activity (test) | Frame-level AUC98.8 | 13 | |
| Abnormality Detection | UCSD Ped1 pixel-level | EER40.8 | 9 |