Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

InstructIR: High-Quality Image Restoration Following Human Instructions

About

Image restoration is a fundamental problem that involves recovering a high-quality clean image from its degraded observation. All-In-One image restoration models can effectively restore images from various types and levels of degradation using degradation-specific information as prompts to guide the restoration model. In this work, we present the first approach that uses human-written instructions to guide the image restoration model. Given natural language prompts, our model can recover high-quality images from their degraded counterparts, considering multiple degradation types. Our method, InstructIR, achieves state-of-the-art results on several restoration tasks including image denoising, deraining, deblurring, dehazing, and (low-light) image enhancement. InstructIR improves +1dB over previous all-in-one restoration methods. Moreover, our dataset and results represent a novel benchmark for new research on text-guided image restoration and enhancement. Our code, datasets and models are available at: https://github.com/mv-lab/InstructIR

Marcos V. Conde, Gregor Geigle, Radu Timofte• 2024

Related benchmarks

TaskDatasetResultRank
Image DeblurringGoPro (test)
PSNR29.73
617
Image DenoisingBSD68
PSNR31.4
404
Image DeblurringGoPro
PSNR29.4
354
DerainingRain100L
PSNR37.98
196
Image DerainingRain100L
PSNR37.98
190
Low-light Image EnhancementLOL
PSNR23
162
Image DerainingRain100L (test)
PSNR37.98
161
Image DehazingSOTS (test)
PSNR30.22
161
DehazingSOTS
PSNR36.84
154
Image DehazingSOTS
PSNR30.22
141
Showing 10 of 140 rows
...

Other info

Follow for update