Self-Supervision with Superpixels: Training Few-shot Medical Image Segmentation without Annotation
About
Few-shot semantic segmentation (FSS) has great potential for medical imaging applications. Most of the existing FSS techniques require abundant annotated semantic classes for training. However, these methods may not be applicable for medical images due to the lack of annotations. To address this problem we make several contributions: (1) A novel self-supervised FSS framework for medical images in order to eliminate the requirement for annotations during training. Additionally, superpixel-based pseudo-labels are generated to provide supervision; (2) An adaptive local prototype pooling module plugged into prototypical networks, to solve the common challenging foreground-background imbalance problem in medical image segmentation; (3) We demonstrate the general applicability of the proposed approach for medical images using three different tasks: abdominal organ segmentation for CT and MRI, as well as cardiac segmentation for MRI. Our results show that, for medical image segmentation, the proposed method outperforms conventional FSS methods which require manual annotations for training.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Medical Image Segmentation | CHAOS-MRI | Spleen Score67.02 | 15 | |
| Few-Shot 3D Volumetric Segmentation | CHAOS-MRI Setting 2 | Dice (Kidney L)73.63 | 13 | |
| Few-Shot 3D Volumetric Segmentation | Abdomen-CT Setting 2 | Dice (LK)63.34 | 13 | |
| Few-Shot 3D Volumetric Segmentation | CHAOS-MRI Setting 1 | Dice Score (LK)81.92 | 12 | |
| Few-Shot 3D Volumetric Segmentation | Abdomen-CT Setting 1 | Dice (LK)72.36 | 9 | |
| Cardiac Medical Image Segmentation | Card-MRI (Setting 1) | LV-BP Dice Score83.99 | 8 | |
| Medical Image Segmentation | Synapse-CT | Spleen Score60.25 | 8 |