Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Image Restoration Through Generalized Ornstein-Uhlenbeck Bridge

About

Diffusion models exhibit powerful generative capabilities enabling noise mapping to data via reverse stochastic differential equations. However, in image restoration, the focus is on the mapping relationship from low-quality to high-quality images. Regarding this issue, we introduce the Generalized Ornstein-Uhlenbeck Bridge (GOUB) model. By leveraging the natural mean-reverting property of the generalized OU process and further eliminating the variance of its steady-state distribution through the Doob's h-transform, we achieve diffusion mappings from point to point enabling the recovery of high-quality images from low-quality ones. Moreover, we unravel the fundamental mathematical essence shared by various bridge models, all of which are special instances of GOUB and empirically demonstrate the optimality of our proposed models. Additionally, we present the corresponding Mean-ODE model adept at capturing both pixel-level details and structural perceptions. Experimental outcomes showcase the state-of-the-art performance achieved by both models across diverse tasks, including inpainting, deraining, and super-resolution. Code is available at \url{https://github.com/Hammour-steak/GOUB}.

Conghan Yue, Zhengwei Peng, Junlong Ma, Shiyan Du, Pengxu Wei, Dongyu Zhang• 2023

Related benchmarks

TaskDatasetResultRank
Low-light Image EnhancementLOL (test)
PSNR19.29
161
Super-ResolutionDIV2K (val)
PSNR28.5
91
Image DerainingRain100H (test)
PSNR31.96
49
Image InpaintingCelebA-HQ 256x256 (test)
FID0.321
28
Image DerainingRain100L
PSNR39.79
19
Image InpaintingCelebA-HQ (test)
LPIPS0.03
18
Image DerainingRain100H
PSNR34.56
15
EnhancementGeneralization Enhancement (test)
MetaIQA0.373
14
DehazingGeneralization Dehazing (test)
MetaIQA0.458
14
Under-display camera image restorationPOLED
PSNR12.922
14
Showing 10 of 19 rows

Other info

Code

Follow for update