BBDM: Image-to-image Translation with Brownian Bridge Diffusion Models
About
Image-to-image translation is an important and challenging problem in computer vision and image processing. Diffusion models (DM) have shown great potentials for high-quality image synthesis, and have gained competitive performance on the task of image-to-image translation. However, most of the existing diffusion models treat image-to-image translation as conditional generation processes, and suffer heavily from the gap between distinct domains. In this paper, a novel image-to-image translation method based on the Brownian Bridge Diffusion Model (BBDM) is proposed, which models image-to-image translation as a stochastic Brownian bridge process, and learns the translation between two domains directly through the bidirectional diffusion process rather than a conditional generation process. To the best of our knowledge, it is the first work that proposes Brownian Bridge diffusion process for image-to-image translation. Experimental results on various benchmarks demonstrate that the proposed BBDM model achieves competitive performance through both visual inspection and measurable metrics.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Alzheimer's disease diagnosis | ADNI | AUC83.29 | 42 | |
| Semantic Image Synthesis | CelebAMask-HQ | FID21.4 | 33 | |
| Image-to-Image Translation | CD3 (test) | PSNR19.8 | 28 | |
| Virtual Staining | IHC(CK8/18) (test) | PSNR20.03 | 27 | |
| CT Reconstruction | PANORAMA Abdomen (test) | PSNR26.82 | 21 | |
| CT Reconstruction | PENGWIN Pelvis (test) | PSNR25.66 | 21 | |
| Sparse-View CT Reconstruction | Knee | VIF0.3168 | 21 | |
| CT Reconstruction | ToothFairy Head (test) | PSNR28.7 | 21 | |
| CT Reconstruction | Knee (test) | PSNR28.9 | 21 | |
| Sparse-View CT Reconstruction | LUNA16 Chest | VIF20 | 21 |