BBDM: Image-to-image Translation with Brownian Bridge Diffusion Models
About
Image-to-image translation is an important and challenging problem in computer vision and image processing. Diffusion models (DM) have shown great potentials for high-quality image synthesis, and have gained competitive performance on the task of image-to-image translation. However, most of the existing diffusion models treat image-to-image translation as conditional generation processes, and suffer heavily from the gap between distinct domains. In this paper, a novel image-to-image translation method based on the Brownian Bridge Diffusion Model (BBDM) is proposed, which models image-to-image translation as a stochastic Brownian bridge process, and learns the translation between two domains directly through the bidirectional diffusion process rather than a conditional generation process. To the best of our knowledge, it is the first work that proposes Brownian Bridge diffusion process for image-to-image translation. Experimental results on various benchmarks demonstrate that the proposed BBDM model achieves competitive performance through both visual inspection and measurable metrics.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Semantic Image Synthesis | CelebAMask-HQ | FID21.4 | 24 | |
| Pressure Synthesis | SLP (test) | MSE (Ucov)0.4817 | 18 | |
| Medical Image-to-Image Translation (T1→T2) | BraTS 2023 (test) | PSNR26.9471 | 14 | |
| Medical Image-to-Image Translation (T2→FLAIR) | BraTS 2023 (test) | PSNR25.8915 | 14 | |
| T1 to T2 MRI translation | IXI (test) | PSNR8.63 | 14 | |
| NPs distribution prediction | NPs distribution dataset 1.0 (Internal val) | SSIM93.01 | 13 | |
| Nanoparticles distribution prediction | B16 tumor model dataset (external val) | SSIM (%)83.86 | 13 | |
| Image-to-Image Translation | edges2shoes | FID10.924 | 11 | |
| Sparse-View CT Reconstruction | ToothFairy (Dental CBCT) 8-View | PSNR27.28 | 10 | |
| Sparse-View CT Reconstruction | ToothFairy Dental CBCT (10-View) | PSNR28 | 10 |