Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Simple Does It: Weakly Supervised Instance and Semantic Segmentation

About

Semantic labelling and instance segmentation are two tasks that require particularly costly annotations. Starting from weak supervision in the form of bounding box detection annotations, we propose a new approach that does not require modification of the segmentation training procedure. We show that when carefully designing the input labels from given bounding boxes, even a single round of training is enough to improve over previously reported weakly supervised results. Overall, our weak supervision approach reaches ~95% of the quality of the fully supervised model, both for semantic labelling and instance segmentation.

Anna Khoreva, Rodrigo Benenson, Jan Hosang, Matthias Hein, Bernt Schiele• 2016

Related benchmarks

TaskDatasetResultRank
Semantic segmentationPASCAL VOC 2012 (val)
Mean IoU74.2
2040
Semantic segmentationPASCAL VOC 2012 (test)
mIoU67.5
1342
Semantic segmentationPASCAL VOC (val)
mIoU77.7
338
Instance SegmentationPASCAL VOC 2012 (val)
mAP @0.544.8
173
Weakly supervised semantic segmentationPASCAL VOC 2012 (test)
mIoU67.5
158
Weakly supervised semantic segmentationPASCAL VOC 2012 (val)
mIoU65.7
154
Instance SegmentationCOCO non-VOC categories
mAP19.7
41
Instance SegmentationPASCAL VOC (val)
AP@0.5044.8
24
Weakly supervised semantic segmentationVOC 2012 (val)
mIoU65.7
19
Instance SegmentationVOC 2012 (val)
AP^r @ IoU=0.546.4
13
Showing 10 of 12 rows

Other info

Follow for update