Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

BBDM: Image-to-image Translation with Brownian Bridge Diffusion Models

About

Image-to-image translation is an important and challenging problem in computer vision and image processing. Diffusion models (DM) have shown great potentials for high-quality image synthesis, and have gained competitive performance on the task of image-to-image translation. However, most of the existing diffusion models treat image-to-image translation as conditional generation processes, and suffer heavily from the gap between distinct domains. In this paper, a novel image-to-image translation method based on the Brownian Bridge Diffusion Model (BBDM) is proposed, which models image-to-image translation as a stochastic Brownian bridge process, and learns the translation between two domains directly through the bidirectional diffusion process rather than a conditional generation process. To the best of our knowledge, it is the first work that proposes Brownian Bridge diffusion process for image-to-image translation. Experimental results on various benchmarks demonstrate that the proposed BBDM model achieves competitive performance through both visual inspection and measurable metrics.

Bo Li, Kaitao Xue, Bin Liu, Yu-Kun Lai• 2022

Related benchmarks

TaskDatasetResultRank
Alzheimer's disease diagnosisADNI
AUC83.29
42
Semantic Image SynthesisCelebAMask-HQ
FID21.4
33
Image-to-Image TranslationCD3 (test)
PSNR19.8
28
Virtual StainingIHC(CK8/18) (test)
PSNR20.03
27
CT ReconstructionPANORAMA Abdomen (test)
PSNR26.82
21
CT ReconstructionPENGWIN Pelvis (test)
PSNR25.66
21
Sparse-View CT ReconstructionKnee
VIF0.3168
21
CT ReconstructionToothFairy Head (test)
PSNR28.7
21
CT ReconstructionKnee (test)
PSNR28.9
21
Sparse-View CT ReconstructionLUNA16 Chest
VIF20
21
Showing 10 of 68 rows

Other info

Code

Follow for update