Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Object Discovery via Contrastive Learning for Weakly Supervised Object Detection

About

Weakly Supervised Object Detection (WSOD) is a task that detects objects in an image using a model trained only on image-level annotations. Current state-of-the-art models benefit from self-supervised instance-level supervision, but since weak supervision does not include count or location information, the most common ``argmax'' labeling method often ignores many instances of objects. To alleviate this issue, we propose a novel multiple instance labeling method called object discovery. We further introduce a new contrastive loss under weak supervision where no instance-level information is available for sampling, called weakly supervised contrastive loss (WSCL). WSCL aims to construct a credible similarity threshold for object discovery by leveraging consistent features for embedding vectors in the same class. As a result, we achieve new state-of-the-art results on MS-COCO 2014 and 2017 as well as PASCAL VOC 2012, and competitive results on PASCAL VOC 2007.

Jinhwan Seo, Wonho Bae, Danica J. Sutherland, Junhyug Noh, Daijin Kim• 2022

Related benchmarks

TaskDatasetResultRank
Object DetectionPASCAL VOC 2007 (test)
mAP56.1
844
Object DetectionPASCAL VOC 2012 (test)
mAP56.2
285
Object DetectionMS-COCO 2017 (test)
AP14.4
82
Object DetectionVOC 2012 (test)
mAP@.5056.2
69
Object DetectionPASCAL VOC 2007
mAP58.7
49
Weakly Supervised Object DetectionPASCAL VOC 2012
mAP54.6
40
Weakly Supervised Object DetectionPASCAL VOC 2007 (test)
mAP@0.556.6
17
Image ClassificationGBC dataset (test)
Accuracy81.5
15
Object DetectionMSCOCO 2014 (test)
mAP@.529.1
14
Object DetectionPASCAL VOC 2007 (trainval)
CorLoc69.8
14
Showing 10 of 15 rows

Other info

Code

Follow for update