AI-Generated Video Detection via Perceptual Straightening
About
The rapid advancement of generative AI enables highly realistic synthetic videos, posing significant challenges for content authentication and raising urgent concerns about misuse. Existing detection methods often struggle with generalization and capturing subtle temporal inconsistencies. We propose ReStraV(Representation Straightening Video), a novel approach to distinguish natural from AI-generated videos. Inspired by the "perceptual straightening" hypothesis -- which suggests real-world video trajectories become more straight in neural representation domain -- we analyze deviations from this expected geometric property. Using a pre-trained self-supervised vision transformer (DINOv2), we quantify the temporal curvature and stepwise distance in the model's representation domain. We aggregate statistics of these measures for each video and train a classifier. Our analysis shows that AI-generated videos exhibit significantly different curvature and distance patterns compared to real videos. A lightweight classifier achieves state-of-the-art detection performance (e.g., 97.17% accuracy and 98.63% AUROC on the VidProM benchmark), substantially outperforming existing image- and video-based methods. ReStraV is computationally efficient, it is offering a low-cost and effective detection solution. This work provides new insights into using neural representation geometry for AI-generated video detection.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| AI-generated Video Detection | EA-Video seen (evaluation) | Accuracy73.6 | 88 | |
| AI-generated Video Detection | EA-Video (test) | Accuracy65.4 | 24 | |
| Video Forgery Detection | GenVideo (test) | Recall (Average)82 | 21 | |
| Synthetic Video Detection | GenVideo (test) | Average Detection Rate89.8 | 20 | |
| Video Forgery Detection | OOD (Out-of-Domain) Video | Vidu Q164.8 | 16 | |
| Video Forgery Detection | MintVid OOD | Fact Score65 | 16 | |
| Video Forgery Detection | Video Datasets ID (In-Domain) GenBuster++, LOKI | GenBuster++ Score50.7 | 16 | |
| Video Forgery Detection | ID, OOD, and OOD-MintVid Aggregated | Average Score53.2 | 16 | |
| Video Forgery Detection | VidProm | Pika Score90.9 | 13 | |
| AI-generated Video Detection | VidProM 2024 (test) | Accuracy (Pika)90.9 | 10 |