Physics-Driven Spatiotemporal Modeling for AI-Generated Video Detection
About
AI-generated videos have achieved near-perfect visual realism (e.g., Sora), urgently necessitating reliable detection mechanisms. However, detecting such videos faces significant challenges in modeling high-dimensional spatiotemporal dynamics and identifying subtle anomalies that violate physical laws. In this paper, we propose a physics-driven AI-generated video detection paradigm based on probability flow conservation principles. Specifically, we propose a statistic called Normalized Spatiotemporal Gradient (NSG), which quantifies the ratio of spatial probability gradients to temporal density changes, explicitly capturing deviations from natural video dynamics. Leveraging pre-trained diffusion models, we develop an NSG estimator through spatial gradients approximation and motion-aware temporal modeling without complex motion decomposition while preserving physical constraints. Building on this, we propose an NSG-based video detection method (NSG-VD) that computes the Maximum Mean Discrepancy (MMD) between NSG features of the test and real videos as a detection metric. Last, we derive an upper bound of NSG feature distances between real and generated videos, proving that generated videos exhibit amplified discrepancies due to distributional shifts. Extensive experiments confirm that NSG-VD outperforms state-of-the-art baselines by 16.00% in Recall and 10.75% in F1-Score, validating the superior performance of NSG-VD. The source code is available at https://github.com/ZSHsh98/NSG-VD.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Video Forgery Detection | GenVideo (test) | Recall (Average)97.13 | 21 | |
| Synthetic Video Detection | GenVideo (test) | Average Detection Rate97.13 | 20 | |
| Video Forgery Detection | OOD (Out-of-Domain) Video | Vidu Q155.1 | 16 | |
| Video Forgery Detection | Video Datasets ID (In-Domain) GenBuster++, LOKI | GenBuster++ Score52.4 | 16 | |
| Video Forgery Detection | MintVid OOD | Fact Score52.8 | 16 | |
| Video Forgery Detection | ID, OOD, and OOD-MintVid Aggregated | Average Score55.1 | 16 | |
| Video Forgery Detection | GenVideo | Sora Detection Rate0.7857 | 15 | |
| AI-generated Video Detection | ViF-Bench T2V 1.0 (test) | Accuracy (Acc)49.65 | 13 | |
| AI-generated Video Detection | ViF-Bench I2V 1.0 (test) | Accuracy49.65 | 7 | |
| AI-generated Video Detection | GenVideo Hot Shot | Accuracy50.29 | 6 |