Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Multiple Instance Detection Network with Online Instance Classifier Refinement

About

Of late, weakly supervised object detection is with great importance in object recognition. Based on deep learning, weakly supervised detectors have achieved many promising results. However, compared with fully supervised detection, it is more challenging to train deep network based detectors in a weakly supervised manner. Here we formulate weakly supervised detection as a Multiple Instance Learning (MIL) problem, where instance classifiers (object detectors) are put into the network as hidden nodes. We propose a novel online instance classifier refinement algorithm to integrate MIL and the instance classifier refinement procedure into a single deep network, and train the network end-to-end with only image-level supervision, i.e., without object location information. More precisely, instance labels inferred from weak supervision are propagated to their spatially overlapped instances to refine instance classifier online. The iterative instance classifier refinement procedure is implemented using multiple streams in deep network, where each stream supervises its latter stream. Weakly supervised object detection experiments are carried out on the challenging PASCAL VOC 2007 and 2012 benchmarks. We obtain 47% mAP on VOC 2007 that significantly outperforms the previous state-of-the-art.

Peng Tang, Xinggang Wang, Xiang Bai, Wenyu Liu• 2017

Related benchmarks

TaskDatasetResultRank
Object DetectionPASCAL VOC 2007 (test)
mAP47
821
Video Object DetectionImageNet VID (val)--
341
Object DetectionPASCAL VOC 2012 (test)
mAP42.5
270
Object DetectionMS-COCO 2017 (val)--
237
Object LocalizationPASCAL VOC 2007 (trainval)
CorLoc66.5
118
Weakly Supervised Object LocalizationPASCAL VOC 2007 (trainval)
CorLoc (Aero)85.8
54
Object DetectionVOC 2007 (test)--
52
Object LocalizationPASCAL VOC 2012 (trainval)
CorLoc65.6
51
Object DetectionPASCAL VOC 2007
mAP41.2
49
Weakly Supervised Object LocalizationPASCAL VOC 2012 (trainval)
Aero CorLoc89.3
21
Showing 10 of 19 rows

Other info

Code

Follow for update