Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Models

About

We propose a novel unpaired image-to-image translation method that uses denoising diffusion probabilistic models without requiring adversarial training. Our method, UNpaired Image Translation with Denoising Diffusion Probabilistic Models (UNIT-DDPM), trains a generative model to infer the joint distribution of images over both domains as a Markov chain by minimising a denoising score matching objective conditioned on the other domain. In particular, we update both domain translation models simultaneously, and we generate target domain images by a denoising Markov Chain Monte Carlo approach that is conditioned on the input source domain images, based on Langevin dynamics. Our approach provides stable model training for image-to-image translation and generates high-quality image outputs. This enables state-of-the-art Fr\'echet Inception Distance (FID) performance on several public datasets, including both colour and multispectral imagery, significantly outperforming the contemporary adversarial image-to-image translation methods.

Hiroshi Sasaki, Chris G. Willcocks, Toby P. Breckon• 2021

Related benchmarks

TaskDatasetResultRank
Across-modality synthesis (T2-weighted MRI to CT)Pelvic MRI-CT dataset (test)
PSNR21.89
42
MRI-CT translationPelvic (T1-CT)
PSNR21.45
18
MRI-CT translation (T1 to CT)Pelvic dataset (test)
PSNR21.45
16
T1 to T2 MRI translationIXI (test)
PSNR22.44
14
MRI Contrast Translation (T1 to T2)BRATS (test)
PSNR23.71
8
MRI Contrast Translation (T2 to FLAIR)BRATS (test)
PSNR24.15
8
MRI Contrast Translation (FLAIR to T1)BRATS (test)
PSNR20.31
8
MRI Contrast Translation (FLAIR to T2)BRATS (test)
PSNR20.03
8
MRI Contrast Translation (T1 to FLAIR)BRATS (test)
PSNR21.33
8
MRI Contrast Translation (T2 to T1)BRATS (test)
PSNR19.84
8
Showing 10 of 15 rows

Other info

Follow for update