FAPE-IR: Frequency-Aware Planning and Execution Framework for All-in-One Image Restoration
About
All-in-One Image Restoration (AIO-IR) aims to develop a unified model that can handle multiple degradations under complex conditions. However, existing methods often rely on task-specific designs or latent routing strategies, making it hard to adapt to real-world scenarios with various degradations. We propose FAPE-IR, a Frequency-Aware Planning and Execution framework for image restoration. It uses a frozen Multimodal Large Language Model (MLLM) as a planner to analyze degraded images and generate concise, frequency-aware restoration plans. These plans guide a LoRA-based Mixture-of-Experts (LoRA-MoE) module within a diffusion-based executor, which dynamically selects high- or low-frequency experts, complemented by frequency features of the input image. To further improve restoration quality and reduce artifacts, we introduce adversarial training and a frequency regularization loss. By coupling semantic planning with frequency-based restoration, FAPE-IR offers a unified and interpretable solution for all-in-one image restoration. Extensive experiments show that FAPE-IR achieves state-of-the-art performance across seven restoration tasks and exhibits strong zero-shot generalization under mixed degradations.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Deblurring | RealBlur-R | PSNR37.77 | 87 | |
| Low-light Image Enhancement | LOL v2 | PSNR25.07 | 37 | |
| Image Super-resolution | RealSR 2× | PSNR29.99 | 7 | |
| Image Super-resolution | DrealSR 2× | PSNR30.52 | 7 | |
| Image Super-resolution | RealSR 4× | PSNR25.55 | 7 | |
| Super-Resolution | RealSR 2x | NIQE7.05 | 7 | |
| Super-Resolution | RealSR and DRealSR (test) | PSNR28.53 | 7 | |
| Image Super-resolution | DrealSR 4× | PSNR28.42 | 7 | |
| Super-Resolution | DrealSR 2x | NIQE7.67 | 7 | |
| Super-Resolution | RealSR 4x | NIQE7.63 | 7 |