Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

InstructIR: High-Quality Image Restoration Following Human Instructions

About

Image restoration is a fundamental problem that involves recovering a high-quality clean image from its degraded observation. All-In-One image restoration models can effectively restore images from various types and levels of degradation using degradation-specific information as prompts to guide the restoration model. In this work, we present the first approach that uses human-written instructions to guide the image restoration model. Given natural language prompts, our model can recover high-quality images from their degraded counterparts, considering multiple degradation types. Our method, InstructIR, achieves state-of-the-art results on several restoration tasks including image denoising, deraining, deblurring, dehazing, and (low-light) image enhancement. InstructIR improves +1dB over previous all-in-one restoration methods. Moreover, our dataset and results represent a novel benchmark for new research on text-guided image restoration and enhancement. Our code, datasets and models are available at: https://github.com/mv-lab/InstructIR

Marcos V. Conde, Gregor Geigle, Radu Timofte• 2024

Related benchmarks

TaskDatasetResultRank
Image DeblurringGoPro (test)
PSNR29.73
585
Image DeblurringGoPro
PSNR29.4
221
Image DerainingRain100L (test)
PSNR37.98
161
Image DehazingSOTS (test)
PSNR30.22
161
Image DerainingRain100L
PSNR37.98
152
Low-light Image EnhancementLOL
PSNR23
122
DehazingSOTS
PSNR36.84
117
DerainingRain100L
PSNR37.98
116
Low-light Image EnhancementLOL v1
PSNR23
113
Image DehazingSOTS Outdoor
PSNR30.22
112
Showing 10 of 93 rows
...

Other info

Follow for update