Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

InstructIR: High-Quality Image Restoration Following Human Instructions

About

Image restoration is a fundamental problem that involves recovering a high-quality clean image from its degraded observation. All-In-One image restoration models can effectively restore images from various types and levels of degradation using degradation-specific information as prompts to guide the restoration model. In this work, we present the first approach that uses human-written instructions to guide the image restoration model. Given natural language prompts, our model can recover high-quality images from their degraded counterparts, considering multiple degradation types. Our method, InstructIR, achieves state-of-the-art results on several restoration tasks including image denoising, deraining, deblurring, dehazing, and (low-light) image enhancement. InstructIR improves +1dB over previous all-in-one restoration methods. Moreover, our dataset and results represent a novel benchmark for new research on text-guided image restoration and enhancement. Our code, datasets and models are available at: https://github.com/mv-lab/InstructIR

Marcos V. Conde, Gregor Geigle, Radu Timofte• 2024

Related benchmarks

TaskDatasetResultRank
Image DeblurringGoPro (test)
PSNR29.73
694
Image DeblurringGoPro
PSNR29.4
441
Image DenoisingBSD68
PSNR31.4
419
DerainingRain100L
PSNR37.98
280
Image DerainingRain100L
PSNR37.98
255
DehazingSOTS
PSNR36.84
238
Low-light Image EnhancementLOL v1
PSNR23
195
Image DehazingSOTS (test)
PSNR30.22
181
Image DehazingSOTS
PSNR30.22
171
Image DerainingRain100L (test)
PSNR37.98
168
Showing 10 of 193 rows
...

Other info

Follow for update