Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Mixup-CAM: Weakly-supervised Semantic Segmentation via Uncertainty Regularization

About

Obtaining object response maps is one important step to achieve weakly-supervised semantic segmentation using image-level labels. However, existing methods rely on the classification task, which could result in a response map only attending on discriminative object regions as the network does not need to see the entire object for optimizing the classification loss. To tackle this issue, we propose a principled and end-to-end train-able framework to allow the network to pay attention to other parts of the object, while producing a more complete and uniform response map. Specifically, we introduce the mixup data augmentation scheme into the classification network and design two uncertainty regularization terms to better interact with the mixup strategy. In experiments, we conduct extensive analysis to demonstrate the proposed method and show favorable performance against state-of-the-art approaches.

Yu-Ting Chang, Qiaosong Wang, Wei-Chih Hung, Robinson Piramuthu, Yi-Hsuan Tsai, Ming-Hsuan Yang• 2020

Related benchmarks

TaskDatasetResultRank
Semantic segmentationPASCAL VOC 2012 (val)
Mean IoU65.6
2040
Semantic segmentationPASCAL VOC 2012 (train)
mIoU61.9
73
Weakly supervised semantic segmentationPASCAL VOC 2012 (train)
mIoU (Mask)61.9
53
Showing 3 of 3 rows

Other info

Follow for update