FlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-Resolution
About
Diffusion models have recently advanced video restoration, but applying them to real-world video super-resolution (VSR) remains challenging due to high latency, prohibitive computation, and poor generalization to ultra-high resolutions. Our goal in this work is to make diffusion-based VSR practical by achieving efficiency, scalability, and real-time performance. To this end, we propose FlashVSR, the first diffusion-based one-step streaming framework towards real-time VSR. FlashVSR runs at approximately 17 FPS for 768x1408 videos on a single A100 GPU by combining three complementary innovations: (i) a train-friendly three-stage distillation pipeline that enables streaming super-resolution, (ii) locality-constrained sparse attention that cuts redundant computation while bridging the train-test resolution gap, and (iii) a tiny conditional decoder that accelerates reconstruction without sacrificing quality. To support large-scale training, we also construct VSR-120K, a new dataset with 120k videos and 180k images. Extensive experiments show that FlashVSR scales reliably to ultra-high resolutions and achieves state-of-the-art performance with up to 12x speedup over prior one-step diffusion VSR models. We will release the code, pretrained models, and dataset to foster future research in efficient diffusion-based VSR.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Video Super-Resolution | REDS4 | SSIM0.6511 | 82 | |
| Video Super-Resolution | SPMCS (test) | Avg. PSNR26.405 | 36 | |
| Video Restoration | REDS30 | PSNR15.48 | 17 | |
| Video Restoration | REDS Spatio-Temporal Light 30 | PSNR20.73 | 10 | |
| Video Restoration | REDS30 Spatio-Temporal Strong | PSNR20.59 | 10 | |
| Video Restoration | YouHQ40 Spatio-Temporal Light | PSNR21.56 | 10 | |
| Video Restoration | REDS30 Spatial Downsampling | PSNR25.87 | 10 | |
| Video Restoration | YouHQ40 Spatio-Temporal Strong | PSNR21.69 | 10 | |
| Video Restoration | REDS30 (test) | PSNR25.566 | 10 | |
| Video Restoration | YouHQ40 Spatial Downsampling | PSNR25.6 | 10 |