SATB-VR: Training Few-Step Video Restoration Diffusion Model using SNR-Aware Trajectory Blending
About
While diffusion models excel in video restoration, their reliance on extensive iterative steps limits efficiency. Conversely, aggressive single-step distillation often compromises fine texture recovery. To achieve an optimal balance, we present SATB-VR, a few-step paradigm that jump-starts the denoising process via an auxiliary predictor, explicitly bypassing early low signal-to-noise ratio (SNR) steps. However, naive joint training of the predictor and the denoiser inherently introduces a severe train-inference discrepancy. To resolve this, we propose the SNR-Aware Trajectory Blending (SATB) strategy. During the forward process, SATB constructs the noisy input by dynamically blending the predictor's output with the ground-truth trajectory based on the SNRs. This forces the denoiser to robustly compensate for initial prediction errors while smoothly converging to the clean data manifold. Furthermore, we introduce a Denoiser-Driven Consistency (DDC) loss, leveraging the concurrently updated denoiser as a dynamic evaluator to explicitly align internal features and boost predictor accuracy. Extensive experiments demonstrate that, under flexible few-step inference regimes (\eg, $\le 5$ steps), SATB-VR performs favorably against existing approaches on synthetic, real-world, and AIGC benchmarks.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Video Restoration | UDM10 (test) | PSNR28.67 | 19 | |
| Video Restoration | VideoLQ (test) | MANIQA0.383 | 9 | |
| Video Restoration | UGC50 (test) | MANIQA0.43 | 9 | |
| Video Restoration | AIGC50 (test) | MANIQA0.415 | 9 | |
| Video Restoration | YouHQ40 (test) | PSNR23.67 | 9 | |
| Video Restoration | SPMCS (test) | PSNR24.18 | 9 |