CW-BASS: Confidence-Weighted Boundary-Aware Learning for Semi-Supervised Semantic Segmentation
About
Semi-supervised semantic segmentation (SSSS) aims to improve segmentation performance by utilizing large amounts of unlabeled data with limited labeled samples. Existing methods often suffer from coupling, where over-reliance on initial labeled data leads to suboptimal learning; confirmation bias, where incorrect predictions reinforce themselves repeatedly; and boundary blur caused by limited boundary-awareness and ambiguous edge cues. To address these issues, we propose CW-BASS, a novel framework for SSSS. In order to mitigate the impact of incorrect predictions, we assign confidence weights to pseudo-labels. Additionally, we leverage boundary-delineation techniques, which, despite being extensively explored in weakly-supervised semantic segmentation (WSSS), remain underutilized in SSSS. Specifically, our method: (1) reduces coupling via a confidence-weighted loss that adjusts pseudo-label influence based on their predicted confidence scores, (2) mitigates confirmation bias with a dynamic thresholding mechanism that learns to filter out pseudo-labels based on model performance, (3) tackles boundary blur using a boundary-aware module to refine segmentation near object edges, and (4) reduces label noise through a confidence decay strategy that progressively refines pseudo-labels during training. Extensive experiments on Pascal VOC 2012 and Cityscapes demonstrate that CW-BASS achieves state-of-the-art performance. Notably, CW-BASS achieves a 65.9% mIoU on Cityscapes under a challenging and underexplored 1/30 (3.3%) split (100 images), highlighting its effectiveness in limited-label settings. Our code is available at https://github.com/psychofict/CW-BASS.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Semantic segmentation | Cityscapes (val) | mIoU78.43 | 572 | |
| Semantic segmentation | PASCAL VOC 2012 (val) | mIoU77.15 | 126 | |
| Semantic segmentation | Pascal VOC 21 classes (val) | mIoU72.8 | 103 | |
| Semantic segmentation | Pascal VOC Classic 2012 (1/8) | Unlabeled Samples per Epoch9.2 | 7 | |
| Semantic segmentation | Pascal VOC Classic 2012 (1/4) | Unlabeled Samples/Epoch7.90e+3 | 7 | |
| Semantic segmentation | Cityscapes 1/16 | Unlabeled Samples/Epoch2.7 | 7 | |
| Semantic segmentation | Cityscapes (1/8) | Unlabeled Samples per Epoch2.6 | 7 | |
| Semantic segmentation | Cityscapes 1/4 | Unlabeled Samples/Epoch2.20e+3 | 7 | |
| Semantic segmentation | Cityscapes (1/2) | Unlabeled Samples/Epoch1.40e+3 | 7 | |
| Semantic segmentation | Pascal VOC Classic 2012 (1/16) | Unlabeled Samples per Epoch9.9 | 7 |