UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Models
About
We propose a novel unpaired image-to-image translation method that uses denoising diffusion probabilistic models without requiring adversarial training. Our method, UNpaired Image Translation with Denoising Diffusion Probabilistic Models (UNIT-DDPM), trains a generative model to infer the joint distribution of images over both domains as a Markov chain by minimising a denoising score matching objective conditioned on the other domain. In particular, we update both domain translation models simultaneously, and we generate target domain images by a denoising Markov Chain Monte Carlo approach that is conditioned on the input source domain images, based on Langevin dynamics. Our approach provides stable model training for image-to-image translation and generates high-quality image outputs. This enables state-of-the-art Fr\'echet Inception Distance (FID) performance on several public datasets, including both colour and multispectral imagery, significantly outperforming the contemporary adversarial image-to-image translation methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Across-modality synthesis (T2-weighted MRI to CT) | Pelvic MRI-CT dataset (test) | PSNR21.89 | 42 | |
| MRI-CT translation | Pelvic (T1-CT) | PSNR21.45 | 18 | |
| MRI-CT translation (T1 to CT) | Pelvic dataset (test) | PSNR21.45 | 16 | |
| T1 to T2 MRI translation | IXI (test) | PSNR22.44 | 14 | |
| MRI Contrast Translation (T1 to T2) | BRATS (test) | PSNR23.71 | 8 | |
| MRI Contrast Translation (T2 to FLAIR) | BRATS (test) | PSNR24.15 | 8 | |
| MRI Contrast Translation (FLAIR to T1) | BRATS (test) | PSNR20.31 | 8 | |
| MRI Contrast Translation (FLAIR to T2) | BRATS (test) | PSNR20.03 | 8 | |
| MRI Contrast Translation (T1 to FLAIR) | BRATS (test) | PSNR21.33 | 8 | |
| MRI Contrast Translation (T2 to T1) | BRATS (test) | PSNR19.84 | 8 |