Tuning Real-World Image Restoration at Inference: A Test-Time Scaling Paradigm for Flow Matching Models
About
Although diffusion-based real-world image restoration (Real-IR) has achieved remarkable progress, efficiently leveraging ultra-large-scale pre-trained text-to-image (T2I) models and fully exploiting their potential remain significant challenges. To address this issue, we propose ResFlow-Tuner, an image restoration framework based on the state-of-the-art flow matching model, FLUX.1-dev, which integrates unified multi-modal fusion (UMMF) with test-time scaling (TTS) to achieve unprecedented restoration performance. Our approach fully leverages the advantages of the Multi-Modal Diffusion Transformer (MM-DiT) architecture by encoding multi-modal conditions into a unified sequence that guides the synthesis of high-quality images. Furthermore, we introduce a training-free test-time scaling paradigm tailored for image restoration. During inference, this technique dynamically steers the denoising direction through feedback from a reward model (RM), thereby achieving significant performance gains with controllable computational overhead. Extensive experiments demonstrate that our method achieves state-of-the-art performance across multiple standard benchmarks. This work not only validates the powerful capabilities of the flow matching model in low-level vision tasks but, more importantly, proposes a novel and efficient inference-time scaling paradigm suitable for large pre-trained models.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Restoration | RealSR | CLIPIQA0.6937 | 26 | |
| Image Restoration | LSDIR (val) | PSNR15.02 | 25 | |
| Image Restoration | DRealSR | CLIPIQA0.7169 | 20 | |
| Image Restoration | RealPhoto60 | PaQ-2-PiQ78.38 | 14 | |
| Image Restoration | DIV2K I (val) | PSNR23.11 | 14 | |
| Image Restoration | DIV2K II (val) | PSNR22.79 | 14 | |
| Image Restoration | DIV2K III (val) | PSNR (dB)19.74 | 14 | |
| OCR recognition | Occluded RoadText 2024 | Precision42.23 | 11 |