Shape-aware Semi-supervised 3D Semantic Segmentation for Medical Images
About
Semi-supervised learning has attracted much attention in medical image segmentation due to challenges in acquiring pixel-wise image annotations, which is a crucial step for building high-performance deep learning methods. Most existing semi-supervised segmentation approaches either tend to neglect geometric constraint in object segments, leading to incomplete object coverage, or impose strong shape prior that requires extra alignment. In this work, we propose a novel shapeaware semi-supervised segmentation strategy to leverage abundant unlabeled data and to enforce a geometric shape constraint on the segmentation output. To achieve this, we develop a multi-task deep network that jointly predicts semantic segmentation and signed distance map(SDM) of object surfaces. During training, we introduce an adversarial loss between the predicted SDMs of labeled and unlabeled data so that our network is able to capture shape-aware features more effectively. Experiments on the Atrial Segmentation Challenge dataset show that our method outperforms current state-of-the-art approaches with improved shape estimation, which validates its efficacy. Code is available at https://github.com/kleinzcy/SASSnet.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Medical Image Segmentation | ACDC (test) | Avg DSC84.5 | 135 | |
| Medical Image Segmentation | LA | Dice89.16 | 97 | |
| Medical Image Segmentation | Kvasir-SEG (test) | mIoU77.21 | 78 | |
| Medical Image Segmentation | LA Atrial Segmentation Challenge 2018 (evaluation) | Dice89.5 | 75 | |
| Segmentation | Pancreas-CT (test) | Dice77.11 | 44 | |
| Image Segmentation | ISIC 2016 (test) | Dice Coefficient89.94 | 40 | |
| Medical Image Segmentation | ACDC 10% labeled (test) | Dice84.5 | 40 | |
| Medical Image Segmentation | ACDC 5% labeled (test) | Dice0.5777 | 30 | |
| 3D Left Atrium Segmentation | LA database 8 scans v1 (10% labeled) | Dice Coefficient87.32 | 23 | |
| 3D Left Atrium Segmentation | LA database 16 labeled scans v1 (20% labeled) | Dice89.54 | 23 |