Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wild

About

We introduce SUPIR (Scaling-UP Image Restoration), a groundbreaking image restoration method that harnesses generative prior and the power of model scaling up. Leveraging multi-modal techniques and advanced generative prior, SUPIR marks a significant advance in intelligent and realistic image restoration. As a pivotal catalyst within SUPIR, model scaling dramatically enhances its capabilities and demonstrates new potential for image restoration. We collect a dataset comprising 20 million high-resolution, high-quality images for model training, each enriched with descriptive text annotations. SUPIR provides the capability to restore images guided by textual prompts, broadening its application scope and potential. Moreover, we introduce negative-quality prompts to further improve perceptual quality. We also develop a restoration-guided sampling method to suppress the fidelity issue encountered in generative-based restoration. Experiments demonstrate SUPIR's exceptional restoration effects and its novel capacity to manipulate restoration through textual prompts.

Fanghua Yu, Jinjin Gu, Zheyuan Li, Jinfan Hu, Xiangtao Kong, Xintao Wang, Jingwen He, Yu Qiao, Chao Dong• 2024

Related benchmarks

TaskDatasetResultRank
Object DetectionCOCO 2017 (val)--
2643
Instance SegmentationCOCO 2017 (val)
APm0.141
1201
Semantic segmentationADE20K
mIoU27.7
1024
Image Super-resolutionDRealSR
MANIQA44.29
130
Image Super-resolutionRealSR
PSNR24.44
130
Image Super-resolutionDIV2K (val)
LPIPS0.3806
106
Super-ResolutionRealSR (test)
PSNR25.16
61
Real-world Image Super-ResolutionRealLQ250
MUSIQ0.6602
45
Real-world Image Super-ResolutionDRealSR
LPIPS0.419
35
Real-world Image Super-ResolutionRealLR200
MUSIQ64.837
34
Showing 10 of 57 rows

Other info

Code

Follow for update