Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Unsupervised Medical Image Translation with Adversarial Diffusion Models

About

Imputation of missing images via source-to-target modality translation can improve diversity in medical imaging protocols. A pervasive approach for synthesizing target images involves one-shot mapping through generative adversarial networks (GAN). Yet, GAN models that implicitly characterize the image distribution can suffer from limited sample fidelity. Here, we propose a novel method based on adversarial diffusion modeling, SynDiff, for improved performance in medical image translation. To capture a direct correlate of the image distribution, SynDiff leverages a conditional diffusion process that progressively maps noise and source images onto the target image. For fast and accurate image sampling during inference, large diffusion steps are taken with adversarial projections in the reverse diffusion direction. To enable training on unpaired datasets, a cycle-consistent architecture is devised with coupled diffusive and non-diffusive modules that bilaterally translate between two modalities. Extensive assessments are reported on the utility of SynDiff against competing GAN and diffusion models in multi-contrast MRI and MRI-CT translation. Our demonstrations indicate that SynDiff offers quantitatively and qualitatively superior performance against competing baselines.

Muzaffer \"Ozbey, Onat Dalmaz, Salman UH Dar, Hasan A Bedel, \c{S}aban \"Ozturk, Alper G\"ung\"or, Tolga \c{C}ukur• 2022

Related benchmarks

TaskDatasetResultRank
Medical Image SynthesisBraTS
SSIM88.31
108
Across-modality synthesis (T2-weighted MRI to CT)Pelvic MRI-CT dataset (test)
PSNR26.86
42
MRI-CT translationPelvic (T1-CT)
PSNR25.47
18
MRI-CT translation (T1 to CT)Pelvic dataset (test)
PSNR25.47
16
Image-to-Image TranslationBCI
SSIM0.38
15
T1 to T2 MRI translationIXI (test)
PSNR30.32
14
Image SynthesisAutoPET Whole-Body CT to PET
PSNR30.27
12
MRI to CT Image SynthesisSynthRAD Brain 2023
MAE23.21
12
Image SynthesisSynthRAD2023 Brain, CT to CBCT
PSNR26.46
12
Image SynthesisSynthRAD Pelvis CBCT to CT 2023
PSNR33.82
12
Showing 10 of 85 rows
...

Other info

Code

Follow for update