Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data

About

Though many attempts have been made in blind super-resolution to restore low-resolution images with unknown and complex degradations, they are still far from addressing general real-world degraded images. In this work, we extend the powerful ESRGAN to a practical restoration application (namely, Real-ESRGAN), which is trained with pure synthetic data. Specifically, a high-order degradation modeling process is introduced to better simulate complex real-world degradations. We also consider the common ringing and overshoot artifacts in the synthesis process. In addition, we employ a U-Net discriminator with spectral normalization to increase discriminator capability and stabilize the training dynamics. Extensive comparisons have shown its superior visual performance than prior works on various real datasets. We also provide efficient implementations to synthesize training pairs on the fly.

Xintao Wang, Liangbin Xie, Chao Dong, Ying Shan• 2021

Related benchmarks

TaskDatasetResultRank
Object DetectionCOCO 2017 (val)--
2843
Instance SegmentationCOCO 2017 (val)
APm0.113
1275
Semantic segmentationADE20K
mIoU17.3
1028
Image Super-resolutionRealSR
PSNR28.02
190
Image Super-resolutionDIV2K (val)
LPIPS0.2123
189
Image Super-resolutionDRealSR
MUSIQ60.18
149
Super-ResolutionDIV2K
PSNR24.29
145
Super-ResolutionRealSR (test)
PSNR25.845
92
Video Super-ResolutionUDM10
PSNR27.13
88
Super-ResolutionImageNet (test)
LPIPS0.2303
70
Showing 10 of 167 rows
...

Other info

Code

Follow for update