Few-shot Medical Image Segmentation with Cycle-resemblance Attention
About
Recently, due to the increasing requirements of medical imaging applications and the professional requirements of annotating medical images, few-shot learning has gained increasing attention in the medical image semantic segmentation field. To perform segmentation with limited number of labeled medical images, most existing studies use Proto-typical Networks (PN) and have obtained compelling success. However, these approaches overlook the query image features extracted from the proposed representation network, failing to preserving the spatial connection between query and support images. In this paper, we propose a novel self-supervised few-shot medical image segmentation network and introduce a novel Cycle-Resemblance Attention (CRA) module to fully leverage the pixel-wise relation between query and support medical images. Notably, we first line up multiple attention blocks to refine more abundant relation information. Then, we present CRAPNet by integrating the CRA module with a classic prototype network, where pixel-wise relations between query and support features are well recaptured for segmentation. Extensive experiments on two different medical image datasets, e.g., abdomen MRI and abdomen CT, demonstrate the superiority of our model over existing state-of-the-art methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Few-Shot 3D Volumetric Segmentation | Abdomen-CT Setting 2 | Dice (LK)70.91 | 13 | |
| Few-Shot 3D Volumetric Segmentation | CHAOS-MRI Setting 2 | Dice (Kidney L)74.66 | 13 | |
| Few-Shot 3D Volumetric Segmentation | CHAOS-MRI Setting 1 | Dice Score (LK)81.95 | 12 | |
| Few-Shot 3D Volumetric Segmentation | Abdomen-CT Setting 1 | Dice (LK)74.69 | 9 | |
| Cardiac Medical Image Segmentation | Card-MRI (Setting 1) | LV-BP Dice Score83.02 | 8 | |
| Medical Image Segmentation | Abd-MRI Setting 1 (test) | Dice LK81.95 | 5 | |
| Medical Image Segmentation | Abd-CT Setting 1 (test) | Dice LK74.69 | 5 | |
| Medical Image Segmentation | Abd-CT Setting 2 (test) | LK Dice Score70.91 | 5 | |
| Medical Image Segmentation | Abd-MRI Setting 2 (test) | Dice LK74.66 | 5 |