Bridging Degradation Discrimination and Generation for Universal Image Restoration
About
Universal image restoration is a critical task in low-level vision, requiring the model to remove various degradations from low-quality images to produce clean images with rich detail. The challenges lie in sampling the distribution of high-quality images and adjusting the outputs on the basis of the degradation. This paper presents a novel approach, Bridging Degradation discrimination and Generation (BDG), which aims to address these challenges concurrently. First, we propose the Multi-Angle and multi-Scale Gray Level Co-occurrence Matrix (MAS-GLCM) and demonstrate its effectiveness in performing fine-grained discrimination of degradation types and levels. Subsequently, we divide the diffusion training process into three distinct stages: generation, bridging, and restoration. The objective is to preserve the diffusion model's capability of restoring rich textures while simultaneously integrating the discriminative information from the MAS-GLCM into the restoration process. This enhances its proficiency in addressing multi-task and multi-degraded scenarios. Without changing the architecture, BDG achieves significant performance gains in all-in-one restoration and real-world super-resolution tasks, primarily evidenced by substantial improvements in fidelity without compromising perceptual quality. The code and pretrained models are provided in https://github.com/MILab-PKU/BDG.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Super-resolution | DRealSR | MANIQA0.4899 | 78 | |
| Image Restoration | CDD11-Double (L+H) | PSNR27.27 | 12 | |
| Image Restoration | CDD11-Double (L+R) | PSNR26.67 | 12 | |
| Image Restoration | CDD11-Double (L+S) | PSNR26.59 | 12 | |
| Image Restoration | CDD11-Double (H+R) | PSNR34.21 | 12 | |
| Image Restoration | CDD11-Double (H+S) | PSNR34.42 | 12 | |
| Image Restoration | CDD11-Triple (L+H+R) | PSNR26.14 | 12 | |
| Image Restoration | CDD11-Triple (L+H+S) | PSNR26.45 | 12 | |
| Real-World Super-Resolution | DIV2K (val) | PSNR24.1977 | 11 | |
| Real-World Super-Resolution | RealSR | PSNR25.5105 | 11 |