Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

AI-Generated Video Detection via Spatio-Temporal Anomaly Learning

About

The advancement of generation models has led to the emergence of highly realistic artificial intelligence (AI)-generated videos. Malicious users can easily create non-existent videos to spread false information. This letter proposes an effective AI-generated video detection (AIGVDet) scheme by capturing the forensic traces with a two-branch spatio-temporal convolutional neural network (CNN). Specifically, two ResNet sub-detectors are learned separately for identifying the anomalies in spatical and optical flow domains, respectively. Results of such sub-detectors are fused to further enhance the discrimination ability. A large-scale generated video dataset (GVD) is constructed as a benchmark for model training and evaluation. Extensive experimental results verify the high generalization and robustness of our AIGVDet scheme. Code and dataset will be available at https://github.com/multimediaFor/AIGVDet.

Jianfa Bai, Man Lin, Gang Cao• 2024

Related benchmarks

TaskDatasetResultRank
Synthetic Video DetectionGenVideo (test)
Average Detection Rate70.14
34
AI-generated Video DetectionVideoPhy 1.0 (test)
CVX Score78.13
28
AI-generated Video DetectionEvalCrafter
Floor33 Score79.52
28
AI-generated Video DetectionVideoPhy
CVX AUC78.13
14
AI-generated Video DetectionGenVideo
MS Score70.91
14
AI-generated Video DetectionVidProm
AUC (MS)60.11
14
AI-generated Video DetectionVidProM (test)
MS Performance63.33
14
Video DetectionVideoPhy
Accuracy53.33
14
Video DetectionVidProm
Accuracy47.25
14
Video DetectionGenVideo
ACC49.07
14
Showing 10 of 24 rows

Other info

Follow for update