Bridging the Gap in Missing Modalities: Leveraging Knowledge Distillation and Style Matching for Brain Tumor Segmentation
About
Accurate and reliable brain tumor segmentation, particularly when dealing with missing modalities, remains a critical challenge in medical image analysis. Previous studies have not fully resolved the challenges of tumor boundary segmentation insensitivity and feature transfer in the absence of key imaging modalities. In this study, we introduce MST-KDNet, aimed at addressing these critical issues. Our model features Multi-Scale Transformer Knowledge Distillation to effectively capture attention weights at various resolutions, Dual-Mode Logit Distillation to improve the transfer of knowledge, and a Global Style Matching Module that integrates feature matching with adversarial learning. Comprehensive experiments conducted on the BraTS and FeTS 2024 datasets demonstrate that MST-KDNet surpasses current leading methods in both Dice and HD95 scores, particularly in conditions with substantial modality loss. Our approach shows exceptional robustness and generalization potential, making it a promising candidate for real-world clinical applications. Our source code is available at https://github.com/Quanato607/MST-KDNet.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Brain Tumor Segmentation | BraTS 2024 | HD952.9 | 77 | |
| Brain Tumor Segmentation | FeTS 2021 | Dice Score (WT)88.4 | 7 | |
| Brain Tumor Segmentation (Enhancing Tumor - ET) | BraTS 2024 (test) | Dice (unimodal)48.3 | 7 | |
| Brain Tumor Segmentation (Tumor Core - TC) | BraTS 2024 (test) | Dice Score (Unimodal TC)47.3 | 7 | |
| Brain Tumor Segmentation (Whole Tumor - WT) | BraTS 2024 (test) | Dice (Unimodal)77.2 | 7 |