Boosting Medical Image Synthesis via Registration-guided Consistency and Disentanglement Learning
About
Medical image synthesis remains challenging due to misalignment noise during training. Existing methods have attempted to address this challenge by incorporating a registration-guided module. However, these methods tend to overlook the task-specific constraints on the synthetic and registration modules, which may cause the synthetic module to still generate spatially aligned images with misaligned target images during training, regardless of the registration module's function. Therefore, this paper proposes registration-guided consistency and incorporates disentanglement learning for medical image synthesis. The proposed registration-guided consistency architecture fosters task-specificity within the synthetic and registration modules by applying identical deformation fields before and after synthesis, while enforcing output consistency through an alignment loss. Moreover, the synthetic module is designed to possess the capability of disentangling anatomical structures and specific styles across various modalities. An anatomy consistency loss is introduced to further compel the synthetic module to preserve geometrical integrity within latent spaces. Experiments conducted on both an in-house abdominal CECT-CT dataset and a publicly available pelvic MR-CT dataset have demonstrated the superiority of the proposed method.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Medical Image Synthesis | BraTS | SSIM88.45 | 108 | |
| CT to CBCT Image Synthesis | SynthRAD Pelvis 2023 | MAE31.51 | 12 | |
| Image Synthesis | SynthRAD2023 Pelvis, CT to CBCT | PSNR26.36 | 12 | |
| CBCT to CT Image Synthesis | SynthRAD Brain 2023 | MAE21.3 | 12 | |
| Image Synthesis | BraTS | Error T1->T25.12 | 12 | |
| Image Synthesis | SynthRAD Brain, CBCT to CT 2023 | PSNR34.21 | 12 | |
| Image Synthesis | SynthRAD Pelvis CT to MRI 2023 | PSNR31.23 | 12 | |
| CBCT to CT Image Synthesis | SynthRAD Pelvis 2023 | MAE20.01 | 12 | |
| CT to CBCT Image Synthesis | SynthRAD2023 Brain | MAE35.99 | 12 | |
| CT to MRI Image Synthesis | SynthRAD Brain 2023 | MAE34.71 | 12 |