Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FAPE-IR: Frequency-Aware Planning and Execution Framework for All-in-One Image Restoration

About

All-in-One Image Restoration (AIO-IR) aims to develop a unified model that can handle multiple degradations under complex conditions. However, existing methods often rely on task-specific designs or latent routing strategies, making it hard to adapt to real-world scenarios with various degradations. We propose FAPE-IR, a Frequency-Aware Planning and Execution framework for image restoration. It uses a frozen Multimodal Large Language Model (MLLM) as a planner to analyze degraded images and generate concise, frequency-aware restoration plans. These plans guide a LoRA-based Mixture-of-Experts (LoRA-MoE) module within a diffusion-based executor, which dynamically selects high- or low-frequency experts, complemented by frequency features of the input image. To further improve restoration quality and reduce artifacts, we introduce adversarial training and a frequency regularization loss. By coupling semantic planning with frequency-based restoration, FAPE-IR offers a unified and interpretable solution for all-in-one image restoration. Extensive experiments show that FAPE-IR achieves state-of-the-art performance across seven restoration tasks and exhibits strong zero-shot generalization under mixed degradations.

Jingren Liu, Shuning Xu, Qirui Yang, Yun Wang, Xiangyu Chen, Zhong Ji• 2025

Related benchmarks

TaskDatasetResultRank
DeblurringRealBlur-R
PSNR37.77
87
Low-light Image EnhancementLOL v2
PSNR25.07
37
Image Super-resolutionRealSR 2×
PSNR29.99
7
Image Super-resolutionDrealSR 2×
PSNR30.52
7
Image Super-resolutionRealSR 4×
PSNR25.55
7
Super-ResolutionRealSR 2x
NIQE7.05
7
Super-ResolutionRealSR and DRealSR (test)
PSNR28.53
7
Image Super-resolutionDrealSR 4×
PSNR28.42
7
Super-ResolutionDrealSR 2x
NIQE7.67
7
Super-ResolutionRealSR 4x
NIQE7.63
7
Showing 10 of 42 rows

Other info

Follow for update