Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Context Decoupling Augmentation for Weakly Supervised Semantic Segmentation

About

Data augmentation is vital for deep learning neural networks. By providing massive training samples, it helps to improve the generalization ability of the model. Weakly supervised semantic segmentation (WSSS) is a challenging problem that has been deeply studied in recent years, conventional data augmentation approaches for WSSS usually employ geometrical transformations, random cropping and color jittering. However, merely increasing the same contextual semantic data does not bring much gain to the networks to distinguish the objects, e.g., the correct image-level classification of "aeroplane" may be not only due to the recognition of the object itself, but also its co-occurrence context like "sky", which will cause the model to focus less on the object features. To this end, we present a Context Decoupling Augmentation (CDA) method, to change the inherent context in which the objects appear and thus drive the network to remove the dependence between object instances and contextual information. To validate the effectiveness of the proposed method, extensive experiments on PASCAL VOC 2012 dataset with several alternative network architectures demonstrate that CDA can boost various popular WSSS methods to the new state-of-the-art by a large margin.

Yukun Su, Ruizhou Sun, Guosheng Lin, Qingyao Wu• 2021

Related benchmarks

TaskDatasetResultRank
Semantic segmentationPASCAL VOC 2012 (val)
Mean IoU66.1
2142
Semantic segmentationPASCAL VOC 2012 (test)
mIoU66.8
1415
Semantic segmentationPASCAL VOC (val)
mIoU66.1
362
Semantic segmentationCOCO 2014 (val)
mIoU33.2
304
Semantic segmentationPascal VOC (test)
mIoU66.8
236
Weakly supervised semantic segmentationPASCAL VOC 2012 (val)
mIoU66.1
168
Weakly supervised semantic segmentationPASCAL VOC 2012 (test)
mIoU66.8
158
Semantic segmentationCOCO (val)
mIoU33.2
150
Weakly supervised semantic segmentationPASCAL VOC 2012 (train)
mIoU (Mask)67.7
53
Pseudo Ground-Truth GenerationPASCAL VOC 2012 (train)
mIoU66.4
19
Showing 10 of 12 rows

Other info

Follow for update