An Intelligent Agentic System for Complex Image Restoration Problems
About
Real-world image restoration (IR) is inherently complex and often requires combining multiple specialized models to address diverse degradations. Inspired by human problem-solving, we propose AgenticIR, an agentic system that mimics the human approach to image processing by following five key stages: Perception, Scheduling, Execution, Reflection, and Rescheduling. AgenticIR leverages large language models (LLMs) and vision-language models (VLMs) that interact via text generation to dynamically operate a toolbox of IR models. We fine-tune VLMs for image quality analysis and employ LLMs for reasoning, guiding the system step by step. To compensate for LLMs' lack of specific IR knowledge and experience, we introduce a self-exploration method, allowing the LLM to observe and summarize restoration results into referenceable documents. Experiments demonstrate AgenticIR's potential in handling complex IR tasks, representing a promising path toward achieving general intelligence in visual processing.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Desnowing | WeatherBench | PSNR20.35 | 17 | |
| Deraining | HQ-NightRain | PSNR16.29 | 10 | |
| Non-Homogeneous Dehazing | NH-HAZE | PSNR12.2 | 10 | |
| UHD Enhancement | UHD-LL | PSNR12.82 | 10 | |
| Dehazing | Dense-Haze | PSNR10.11 | 10 | |
| Motion Deblurring | 4KRD | PSNR24.41 | 10 | |
| Denoising | PolyU | MUSIQ35.98 | 10 | |
| Joint Denoising and Enhancement | FoundIR-L+N | PSNR10.73 | 10 | |
| Raindrop Removal | UAV-Rain1k | PSNR14.26 | 10 | |
| Defocus Deblurring | LSD | PSNR18.3 | 10 |