Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Tuning Real-World Image Restoration at Inference: A Test-Time Scaling Paradigm for Flow Matching Models

About

Although diffusion-based real-world image restoration (Real-IR) has achieved remarkable progress, efficiently leveraging ultra-large-scale pre-trained text-to-image (T2I) models and fully exploiting their potential remain significant challenges. To address this issue, we propose ResFlow-Tuner, an image restoration framework based on the state-of-the-art flow matching model, FLUX.1-dev, which integrates unified multi-modal fusion (UMMF) with test-time scaling (TTS) to achieve unprecedented restoration performance. Our approach fully leverages the advantages of the Multi-Modal Diffusion Transformer (MM-DiT) architecture by encoding multi-modal conditions into a unified sequence that guides the synthesis of high-quality images. Furthermore, we introduce a training-free test-time scaling paradigm tailored for image restoration. During inference, this technique dynamically steers the denoising direction through feedback from a reward model (RM), thereby achieving significant performance gains with controllable computational overhead. Extensive experiments demonstrate that our method achieves state-of-the-art performance across multiple standard benchmarks. This work not only validates the powerful capabilities of the flow matching model in low-level vision tasks but, more importantly, proposes a novel and efficient inference-time scaling paradigm suitable for large pre-trained models.

Purui Bai, Junxian Duan, Pin Wang, Jinhua Hao, Ming Sun, Chao Zhou, Huaibo Huang• 2026

Related benchmarks

TaskDatasetResultRank
Image RestorationRealSR
CLIPIQA0.6937
26
Image RestorationLSDIR (val)
PSNR15.02
25
Image RestorationDRealSR
CLIPIQA0.7169
20
Image RestorationRealPhoto60
PaQ-2-PiQ78.38
14
Image RestorationDIV2K I (val)
PSNR23.11
14
Image RestorationDIV2K II (val)
PSNR22.79
14
Image RestorationDIV2K III (val)
PSNR (dB)19.74
14
OCR recognitionOccluded RoadText 2024
Precision42.23
11
Showing 8 of 8 rows

Other info

Follow for update