Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

An Intelligent Agentic System for Complex Image Restoration Problems

About

Real-world image restoration (IR) is inherently complex and often requires combining multiple specialized models to address diverse degradations. Inspired by human problem-solving, we propose AgenticIR, an agentic system that mimics the human approach to image processing by following five key stages: Perception, Scheduling, Execution, Reflection, and Rescheduling. AgenticIR leverages large language models (LLMs) and vision-language models (VLMs) that interact via text generation to dynamically operate a toolbox of IR models. We fine-tune VLMs for image quality analysis and employ LLMs for reasoning, guiding the system step by step. To compensate for LLMs' lack of specific IR knowledge and experience, we introduce a self-exploration method, allowing the LLM to observe and summarize restoration results into referenceable documents. Experiments demonstrate AgenticIR's potential in handling complex IR tasks, representing a promising path toward achieving general intelligence in visual processing.

Kaiwen Zhu, Jinjin Gu, Zhiyuan You, Yu Qiao, Chao Dong• 2024

Related benchmarks

TaskDatasetResultRank
DesnowingWeatherBench
PSNR20.35
17
DerainingHQ-NightRain
PSNR16.29
10
Non-Homogeneous DehazingNH-HAZE
PSNR12.2
10
UHD EnhancementUHD-LL
PSNR12.82
10
DehazingDense-Haze
PSNR10.11
10
Motion Deblurring4KRD
PSNR24.41
10
DenoisingPolyU
MUSIQ35.98
10
Joint Denoising and EnhancementFoundIR-L+N
PSNR10.73
10
Raindrop RemovalUAV-Rain1k
PSNR14.26
10
Defocus DeblurringLSD
PSNR18.3
10
Showing 10 of 17 rows

Other info

Follow for update