Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MambaIR: A Simple Baseline for Image Restoration with State-Space Model

About

Recent years have seen significant advancements in image restoration, largely attributed to the development of modern deep neural networks, such as CNNs and Transformers. However, existing restoration backbones often face the dilemma between global receptive fields and efficient computation, hindering their application in practice. Recently, the Selective Structured State Space Model, especially the improved version Mamba, has shown great potential for long-range dependency modeling with linear complexity, which offers a way to resolve the above dilemma. However, the standard Mamba still faces certain challenges in low-level vision such as local pixel forgetting and channel redundancy. In this work, we introduce a simple but effective baseline, named MambaIR, which introduces both local enhancement and channel attention to improve the vanilla Mamba. In this way, our MambaIR takes advantage of the local pixel similarity and reduces the channel redundancy. Extensive experiments demonstrate the superiority of our method, for example, MambaIR outperforms SwinIR by up to 0.45dB on image SR, using similar computational cost but with a global receptive field. Code is available at \url{https://github.com/csguoh/MambaIR}.

Hang Guo, Jinmin Li, Tao Dai, Zhihao Ouyang, Xudong Ren, Shu-Tao Xia• 2024

Related benchmarks

TaskDatasetResultRank
Image Super-resolutionManga109
PSNR40.28
656
Image DeblurringGoPro (test)
PSNR28.61
585
Image Super-resolutionSet5 (test)
PSNR38.6
544
Image Super-resolutionSet5
PSNR38.13
507
Single Image Super-ResolutionUrban100
PSNR29.93
500
Super-ResolutionB100 (test)
PSNR32.58
363
Single Image Super-ResolutionSet5
PSNR38.16
352
Image Super-resolutionSet14
PSNR34.67
329
Image Super-resolutionSet14 (test)
PSNR34.69
292
Single Image Super-ResolutionUrban100 (test)
PSNR34.17
289
Showing 10 of 92 rows
...

Other info

Code

Follow for update