Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

BBDM: Image-to-image Translation with Brownian Bridge Diffusion Models

About

Image-to-image translation is an important and challenging problem in computer vision and image processing. Diffusion models (DM) have shown great potentials for high-quality image synthesis, and have gained competitive performance on the task of image-to-image translation. However, most of the existing diffusion models treat image-to-image translation as conditional generation processes, and suffer heavily from the gap between distinct domains. In this paper, a novel image-to-image translation method based on the Brownian Bridge Diffusion Model (BBDM) is proposed, which models image-to-image translation as a stochastic Brownian bridge process, and learns the translation between two domains directly through the bidirectional diffusion process rather than a conditional generation process. To the best of our knowledge, it is the first work that proposes Brownian Bridge diffusion process for image-to-image translation. Experimental results on various benchmarks demonstrate that the proposed BBDM model achieves competitive performance through both visual inspection and measurable metrics.

Bo Li, Kaitao Xue, Bin Liu, Yu-Kun Lai• 2022

Related benchmarks

TaskDatasetResultRank
Semantic Image SynthesisCelebAMask-HQ
FID21.4
24
Pressure SynthesisSLP (test)
MSE (Ucov)0.4817
18
Medical Image-to-Image Translation (T1→T2)BraTS 2023 (test)
PSNR26.9471
14
Medical Image-to-Image Translation (T2→FLAIR)BraTS 2023 (test)
PSNR25.8915
14
T1 to T2 MRI translationIXI (test)
PSNR8.63
14
NPs distribution predictionNPs distribution dataset 1.0 (Internal val)
SSIM93.01
13
Nanoparticles distribution predictionB16 tumor model dataset (external val)
SSIM (%)83.86
13
Image-to-Image Translationedges2shoes
FID10.924
11
Sparse-View CT ReconstructionToothFairy (Dental CBCT) 8-View
PSNR27.28
10
Sparse-View CT ReconstructionToothFairy Dental CBCT (10-View)
PSNR28
10
Showing 10 of 39 rows

Other info

Code

Follow for update