Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Image Restoration Through Generalized Ornstein-Uhlenbeck Bridge

About

Diffusion models exhibit powerful generative capabilities enabling noise mapping to data via reverse stochastic differential equations. However, in image restoration, the focus is on the mapping relationship from low-quality to high-quality images. Regarding this issue, we introduce the Generalized Ornstein-Uhlenbeck Bridge (GOUB) model. By leveraging the natural mean-reverting property of the generalized OU process and further eliminating the variance of its steady-state distribution through the Doob's h-transform, we achieve diffusion mappings from point to point enabling the recovery of high-quality images from low-quality ones. Moreover, we unravel the fundamental mathematical essence shared by various bridge models, all of which are special instances of GOUB and empirically demonstrate the optimality of our proposed models. Additionally, we present the corresponding Mean-ODE model adept at capturing both pixel-level details and structural perceptions. Experimental outcomes showcase the state-of-the-art performance achieved by both models across diverse tasks, including inpainting, deraining, and super-resolution. Code is available at \url{https://github.com/Hammour-steak/GOUB}.

Conghan Yue, Zhengwei Peng, Junlong Ma, Shiyan Du, Pengxu Wei, Dongyu Zhang• 2023

Related benchmarks

TaskDatasetResultRank
Super-ResolutionDIV2K (val)
PSNR28.5
44
Image DerainingRain100L
PSNR39.79
19
Image InpaintingCelebA-HQ 256x256 (test)
FID4.3
19
DerainingRain100L
PSNR39.79
9
Image DerainingRain100H
PSNR34.56
7
8x Image Super-ResolutionDIV2K (test)
PSNR23.17
3
Image InpaintingCelebA-HQ thick mask
PSNR22.27
3
Showing 7 of 7 rows

Other info

Code

Follow for update