Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-Resolution

About

Pre-trained text-to-image diffusion models are increasingly applied to real-world image super-resolution (Real-ISR) task. Given the iterative refinement nature of diffusion models, most existing approaches are computationally expensive. While methods such as SinSR and OSEDiff have emerged to condense inference steps via distillation, their performance in image restoration or details recovery is not satisfied. To address this, we propose TSD-SR, a novel distillation framework specifically designed for real-world image super-resolution, aiming to construct an efficient and effective one-step model. We first introduce the Target Score Distillation, which leverages the priors of diffusion models and real image references to achieve more realistic image restoration. Secondly, we propose a Distribution-Aware Sampling Module to make detail-oriented gradients more readily accessible, addressing the challenge of recovering fine details. Extensive experiments demonstrate that our TSD-SR has superior restoration results (most of the metrics perform the best) and the fastest inference speed (e.g. 40 times faster than SeeSR) compared to the past Real-ISR approaches based on pre-trained diffusion priors.

Linwei Dong, Qingnan Fan, Yihong Guo, Zhonghao Wang, Qi Zhang, Jinwei Chen, Yawei Luo, Changqing Zou• 2024

Related benchmarks

TaskDatasetResultRank
Image Super-resolutionDRealSR
MANIQA0.582
130
Image Super-resolutionRealSR
PSNR23.76
130
Image Super-resolutionDIV2K (val)
LPIPS0.2679
106
Real-world Image Super-ResolutionRealLQ250
MUSIQ0.715
45
Super-ResolutionRealLQ250
NIQE3.4868
25
Real-World Super-ResolutionRealSR
PSNR23.736
22
Key Photo RestorationiPhoneLive90
NIre0.2963
16
Key Photo RestorationvivoLive144
NIre33.59
16
Image RestorationSynLive260
PSNR25.34
16
Image Super-resolutionRealLQ250 4x (test)
NIQE3.4879
15
Showing 10 of 22 rows

Other info

Follow for update