MAP-based Problem-Agnostic diffusion model for Inverse Problems
About
Diffusion models have indeed shown great promise in solving inverse problems in image processing. In this paper, we propose a novel, problem-agnostic diffusion model called the maximum a posteriori (MAP)-based guided term estimation method for inverse problems. To leverage unconditionally pretrained diffusion models to address conditional generation tasks, we divide the conditional score function into two terms according to Bayes' rule: an unconditional score function (approximated by a pretrained score network) and a guided term, which is estimated using a novel MAP-based method that incorporates a Gaussian-type prior of natural images. This innovation allows us to better capture the intrinsic properties of the data, leading to improved performance. Numerical results demonstrate that our method preserves contents more effectively compared to state-of-the-art methods--for example, maintaining the structure of glasses in super-resolution tasks and producing more coherent results in the neighborhood of masked regions during inpainting.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Denoising | CelebA-HQ 256x256-1k (val) | PSNR37.69 | 12 | |
| Super-Resolution | FFHQ 1k samples 256x256 (val) | FID30.34 | 9 | |
| Image Restoration | Linear Inverse Problems | Inference Time (s)1.643 | 7 | |
| Denoising | FFHQ 256x256-1k (val) | PSNR30.24 | 6 | |
| Denoising | FFHQ 1k (sigma=0.05) 256x256 (val) | PSNR35.67 | 6 | |
| Denoising | FFHQ 1k (sigma=0.1) 256x256 (val) | PSNR35.37 | 6 | |
| Denoising | FFHQ 1k sigma=0.2 256x256 (val) | PSNR32.67 | 6 | |
| Denoising | CelebA-HQ 1k (sigma=0.05) 256x256 (val) | PSNR38.19 | 6 | |
| Denoising | CelebA-HQ 1k (sigma=0.2) 256x256 (val) | PSNR34.61 | 6 | |
| Image Inpainting | FFHQ Box mask 256x256-1k (val) | PSNR30.06 | 6 |