Linear Recurrent Unit with Semantic Modulation for Image Super-Resolution
About
Linear recurrent unit (LRU), designed with a principled formulation for stable linear recurrence, has demonstrated promising accuracy and robustness on long-range dependency tasks. However, its static parameterization and single-scan method limits its applicability to 2D vision tasks. In this study, we propose a LRU-based restoration network with a semantic modulating unit (SMU) to achieve a harmonious balance between performance and efficiency in single-image super-resolution. The SMU plays three key roles: LRU modulation, spatial categorization, and feature enhancement through learned prototype. Extensive experiments demonstrate that our method quantitatively and qualitatively surpasses recent state-of-the-art methods. Notably, our approach achieves superior performance with computational complexity on par with existing methods. The source code and models are available at https://github.com/MingyuChoi-run/LSM
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Super-resolution | Urban100 x4 (test) | PSNR27.94 | 316 | |
| Super-Resolution | Urban100 x4 | PSNR28.07 | 136 | |
| Image Super-resolution | Urban100 x2 (test) | PSNR34.43 | 123 | |
| Super-Resolution | Urban100 x2 | PSNR33.24 | 112 | |
| Image Super-resolution | Manga109 x2 (test) | PSNR40.35 | 97 | |
| Image Super-resolution | Manga109 x4 (test) | PSNR32.42 | 79 | |
| Super-Resolution | Manga109 2x | PSNR39.35 | 79 | |
| Image Super-resolution | B100 x4 (test) | PSNR28 | 76 | |
| Single Image Super-Resolution | Set5 x4 (test) | PSNR32.96 | 45 | |
| Super-Resolution | B100 x2 | PSNR32.39 | 43 |