InstructIR: High-Quality Image Restoration Following Human Instructions
About
Image restoration is a fundamental problem that involves recovering a high-quality clean image from its degraded observation. All-In-One image restoration models can effectively restore images from various types and levels of degradation using degradation-specific information as prompts to guide the restoration model. In this work, we present the first approach that uses human-written instructions to guide the image restoration model. Given natural language prompts, our model can recover high-quality images from their degraded counterparts, considering multiple degradation types. Our method, InstructIR, achieves state-of-the-art results on several restoration tasks including image denoising, deraining, deblurring, dehazing, and (low-light) image enhancement. InstructIR improves +1dB over previous all-in-one restoration methods. Moreover, our dataset and results represent a novel benchmark for new research on text-guided image restoration and enhancement. Our code, datasets and models are available at: https://github.com/mv-lab/InstructIR
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Deblurring | GoPro (test) | PSNR29.73 | 585 | |
| Image Deblurring | GoPro | PSNR29.4 | 221 | |
| Image Deraining | Rain100L (test) | PSNR37.98 | 161 | |
| Image Dehazing | SOTS (test) | PSNR30.22 | 161 | |
| Image Deraining | Rain100L | PSNR37.98 | 152 | |
| Low-light Image Enhancement | LOL | PSNR23 | 122 | |
| Dehazing | SOTS | PSNR36.84 | 117 | |
| Deraining | Rain100L | PSNR37.98 | 116 | |
| Low-light Image Enhancement | LOL v1 | PSNR23 | 113 | |
| Image Dehazing | SOTS Outdoor | PSNR30.22 | 112 |