Local Implicit Normalizing Flow for Arbitrary-Scale Image Super-Resolution
About
Flow-based methods have demonstrated promising results in addressing the ill-posed nature of super-resolution (SR) by learning the distribution of high-resolution (HR) images with the normalizing flow. However, these methods can only perform a predefined fixed-scale SR, limiting their potential in real-world applications. Meanwhile, arbitrary-scale SR has gained more attention and achieved great progress. Nonetheless, previous arbitrary-scale SR methods ignore the ill-posed problem and train the model with per-pixel L1 loss, leading to blurry SR outputs. In this work, we propose "Local Implicit Normalizing Flow" (LINF) as a unified solution to the above problems. LINF models the distribution of texture details under different scaling factors with normalizing flow. Thus, LINF can generate photo-realistic HR images with rich texture details in arbitrary scale factors. We evaluate LINF with extensive experiments and show that LINF achieves the state-of-the-art perceptual quality compared with prior arbitrary-scale SR methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Super-resolution | Set5 (test) | -- | 626 | |
| Super-Resolution | DIV2K 2017 (test) | PSNR24.3 | 30 | |
| Super-Resolution | DIV2K 4x (val) | PSNR27.33 | 24 | |
| Image Super-resolution | M3FD x2 scale (test) | MI2.9892 | 10 | |
| Image Super-resolution | M3FD x4 scale (test) | MI Score3.0031 | 10 | |
| Arbitrary-scale Super-Resolution | Urban100 x6 scale | PSNR24.18 | 10 | |
| Arbitrary-scale Super-Resolution | Urban100 x12 scale | PSNR21.12 | 10 | |
| Arbitrary-scale Super-Resolution | Urban100 x2 scale | PSNR32.87 | 10 | |
| Arbitrary-scale Super-Resolution | Urban100 x3 scale | PSNR28.82 | 10 | |
| Arbitrary-scale Super-Resolution | Urban100 x4 scale | PSNR26.69 | 10 |