From Zero to Detail: Deconstructing Ultra-High-Definition Image Restoration from Progressive Spectral Perspective
About
Ultra-high-definition (UHD) image restoration faces significant challenges due to its high resolution, complex content, and intricate details. To cope with these challenges, we analyze the restoration process in depth through a progressive spectral perspective, and deconstruct the complex UHD restoration problem into three progressive stages: zero-frequency enhancement, low-frequency restoration, and high-frequency refinement. Building on this insight, we propose a novel framework, ERR, which comprises three collaborative sub-networks: the zero-frequency enhancer (ZFE), the low-frequency restorer (LFR), and the high-frequency refiner (HFR). Specifically, the ZFE integrates global priors to learn global mapping, while the LFR restores low-frequency information, emphasizing reconstruction of coarse-grained content. Finally, the HFR employs our designed frequency-windowed kolmogorov-arnold networks (FW-KAN) to refine textures and details, producing high-quality image restoration. Our approach significantly outperforms previous UHD methods across various tasks, with extensive ablation studies validating the effectiveness of each component. The code is available at \href{https://github.com/NJU-PCALab/ERR}{here}.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Deblurring | GoPro | PSNR33 | 354 | |
| Deblurring | RealBlur-R | PSNR35.6 | 87 | |
| Deblurring | RealBlur-J | PSNR28.1 | 84 | |
| Low-light Image Enhancement | UHD-LL (test) | PSNR27.57 | 29 | |
| Image Deblurring | UHD-Blur (test) | PSNR29.72 | 27 | |
| Image Deblurring | UHD-Blur | PSNR29.72 | 26 | |
| Image Deblurring | MC-Blur UHDM | PSNR27.23 | 15 | |
| Image Deblurring | DVD | PSNR33.25 | 15 | |
| Low-light Image Enhancement | UHD-LL | PSNR27.57 | 12 | |
| Image Deraining | Rain13k 4K 1 (test) | PSNR34.48 | 11 |