Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-Resolution

About

Pre-trained text-to-image diffusion models are increasingly applied to real-world image super-resolution (Real-ISR) task. Given the iterative refinement nature of diffusion models, most existing approaches are computationally expensive. While methods such as SinSR and OSEDiff have emerged to condense inference steps via distillation, their performance in image restoration or details recovery is not satisfied. To address this, we propose TSD-SR, a novel distillation framework specifically designed for real-world image super-resolution, aiming to construct an efficient and effective one-step model. We first introduce the Target Score Distillation, which leverages the priors of diffusion models and real image references to achieve more realistic image restoration. Secondly, we propose a Distribution-Aware Sampling Module to make detail-oriented gradients more readily accessible, addressing the challenge of recovering fine details. Extensive experiments demonstrate that our TSD-SR has superior restoration results (most of the metrics perform the best) and the fastest inference speed (e.g. 40 times faster than SeeSR) compared to the past Real-ISR approaches based on pre-trained diffusion priors.

Linwei Dong, Qingnan Fan, Yihong Guo, Zhonghao Wang, Qi Zhang, Jinwei Chen, Yawei Luo, Changqing Zou• 2024

Related benchmarks

TaskDatasetResultRank
Image Super-resolutionRealSR
PSNR24.81
190
Image Super-resolutionDIV2K (val)
LPIPS0.2673
189
Image Super-resolutionDRealSR
MUSIQ66.12
149
Super-ResolutionRealSR (test)
PSNR24.81
92
Real-world Image Super-ResolutionDRealSR
LPIPS0.2967
62
Real-world Image Super-ResolutionRealLQ250
MUSIQ0.715
59
Super-ResolutionRealLQ250
MUSIQ72.09
49
Real-World Super-ResolutionRealSR
PSNR23.736
36
Super-ResolutionDRealSR
PSNR27.77
27
Real-world Single Image Super-ResolutionDRealSR (test)
PSNR27.77
23
Showing 10 of 29 rows

Other info

Follow for update