Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Generalized Real-World Super-Resolution through Adversarial Robustness

About

Real-world Super-Resolution (SR) has been traditionally tackled by first learning a specific degradation model that resembles the noise and corruption artifacts in low-resolution imagery. Thus, current methods lack generalization and lose their accuracy when tested on unseen types of corruption. In contrast to the traditional proposal, we present Robust Super-Resolution (RSR), a method that leverages the generalization capability of adversarial attacks to tackle real-world SR. Our novel framework poses a paradigm shift in the development of real-world SR methods. Instead of learning a dataset-specific degradation, we employ adversarial attacks to create difficult examples that target the model's weaknesses. Afterward, we use these adversarial examples during training to improve our model's capacity to process noisy inputs. We perform extensive experimentation on synthetic and real-world images and empirically demonstrate that our RSR method generalizes well across datasets without re-training for specific noise priors. By using a single robust model, we outperform state-of-the-art specialized methods on real-world benchmarks.

Angela Castillo, Mar\'ia Escobar, Juan C. P\'erez, Andr\'es Romero, Radu Timofte, Luc Van Gool, Pablo Arbel\'aez• 2021

Related benchmarks

TaskDatasetResultRank
Super-ResolutionAIM (val)
PSNR21.99
17
Real-World Super-ResolutionNTIRE 2020 (val)
PSNR24.31
13
Single Image Super-ResolutionDIV2K Blurry (val)
PSNR22.15
6
Super-ResolutionDIV2K PGD attack (val)
PSNR24.21
6
Super-ResolutionDIV2K CW attack (val)
PSNR25.15
6
Single Image Super-ResolutionDIV2K Clean (val)
PSNR26.6
6
Single Image Super-ResolutionDIV2K Noisy (val)
PSNR22.63
6
Super-ResolutionDIV2K FGSM attack (val)
PSNR21.74
6
Super-ResolutionDIV2K BIM attack (val)
PSNR19.45
6
Super-ResolutionNTIRE (val)
PSNR24.31
4
Showing 10 of 10 rows

Other info

Follow for update