Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-Resolution

About

Pre-trained text-to-image diffusion models are increasingly applied to real-world image super-resolution (Real-ISR) task. Given the iterative refinement nature of diffusion models, most existing approaches are computationally expensive. While methods such as SinSR and OSEDiff have emerged to condense inference steps via distillation, their performance in image restoration or details recovery is not satisfied. To address this, we propose TSD-SR, a novel distillation framework specifically designed for real-world image super-resolution, aiming to construct an efficient and effective one-step model. We first introduce the Target Score Distillation, which leverages the priors of diffusion models and real image references to achieve more realistic image restoration. Secondly, we propose a Distribution-Aware Sampling Module to make detail-oriented gradients more readily accessible, addressing the challenge of recovering fine details. Extensive experiments demonstrate that our TSD-SR has superior restoration results (most of the metrics perform the best) and the fastest inference speed (e.g. 40 times faster than SeeSR) compared to the past Real-ISR approaches based on pre-trained diffusion priors.

Linwei Dong, Qingnan Fan, Yihong Guo, Zhonghao Wang, Qi Zhang, Jinwei Chen, Yawei Luo, Changqing Zou• 2024

Related benchmarks

TaskDatasetResultRank
Image Super-resolutionRealSR
LPIPS0.2743
257
Image Super-resolutionDIV2K (val)
LPIPS0.2673
215
Image Super-resolutionDRealSR
MUSIQ66.62
182
Super-ResolutionImageNet (test)
LPIPS0.197
110
Super-ResolutionRealSR (test)
PSNR24.81
107
Real-world Image Super-ResolutionDRealSR
LPIPS0.2966
69
Super-ResolutionRealLQ250
MUSIQ72.09
59
Real-world Image Super-ResolutionRealLQ250
MUSIQ0.715
59
Image Super-resolutionRealLR200
MANIQA0.6248
36
Real-World Super-ResolutionRealSR
PSNR23.736
36
Showing 10 of 37 rows

Other info

Follow for update