Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

An Exploratory Study on Human-Centric Video Anomaly Detection through Variational Autoencoders and Trajectory Prediction

About

Video Anomaly Detection (VAD) represents a challenging and prominent research task within computer vision. In recent years, Pose-based Video Anomaly Detection (PAD) has drawn considerable attention from the research community due to several inherent advantages over pixel-based approaches despite the occasional suboptimal performance. Specifically, PAD is characterized by reduced computational complexity, intrinsic privacy preservation, and the mitigation of concerns related to discrimination and bias against specific demographic groups. This paper introduces TSGAD, a novel human-centric Two-Stream Graph-Improved Anomaly Detection leveraging Variational Autoencoders (VAEs) and trajectory prediction. TSGAD aims to explore the possibility of utilizing VAEs as a new approach for pose-based human-centric VAD alongside the benefits of trajectory prediction. We demonstrate TSGAD's effectiveness through comprehensive experimentation on benchmark datasets. TSGAD demonstrates comparable results with state-of-the-art methods showcasing the potential of adopting variational autoencoders. This suggests a promising direction for future research endeavors. The code base for this work is available at https://github.com/TeCSAR-UNCC/TSGAD.

Ghazal Alinezhad Noghre, Armin Danesh Pazho, Hamed Tabkhi• 2024

Related benchmarks

TaskDatasetResultRank
Video Anomaly DetectionShanghaiTech Human-Related SHT-HR
AUROC81.5
17
Video Anomaly DetectionCHAD (test)--
12
Video Anomaly DetectionSHT
AUC ROC0.8067
10
Video Anomaly DetectionSHT (test)
EER0.25
10
Video Anomaly DetectionShanghaiTech (SHT) original (full)
AUROC80.6
9
Video Anomaly DetectionHR-SHT
AUC-ROC81.77
8
Video Anomaly DetectionHR-SHT (test)
EER0.25
8
Event-level Video Anomaly DetectionNWPU Campus (NWPUC) 4 (test)
Precision (tIOU=0.5)4.26
7
Event-level Video Anomaly DetectionHuVAD (Human Video Anomaly Detection) 25 (test)
Precision (tIOU=0.5)15.18
7
Video Anomaly DetectionNWPUC (NWPU Campus)
Precision (tIOU=0.5)2.3
7
Showing 10 of 25 rows

Other info

Code

Follow for update