Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Label, Verify, Correct: A Simple Few Shot Object Detection Method

About

The objective of this paper is few-shot object detection (FSOD) -- the task of expanding an object detector for a new category given only a few instances for training. We introduce a simple pseudo-labelling method to source high-quality pseudo-annotations from the training set, for each new category, vastly increasing the number of training instances and reducing class imbalance; our method finds previously unlabelled instances. Na\"ively training with model predictions yields sub-optimal performance; we present two novel methods to improve the precision of the pseudo-labelling process: first, we introduce a verification technique to remove candidate detections with incorrect class labels; second, we train a specialised model to correct poor quality bounding boxes. After these two novel steps, we obtain a large set of high-quality pseudo-annotations that allow our final detector to be trained end-to-end. Additionally, we demonstrate our method maintains base class performance, and the utility of simple augmentations in FSOD. While benchmarking on PASCAL VOC and MS-COCO, our method achieves state-of-the-art or second-best performance compared to existing approaches across all number of shots.

Prannay Kaul, Weidi Xie, Andrew Zisserman• 2021

Related benchmarks

TaskDatasetResultRank
Object DetectionMS COCO novel classes
nAP2.45e+3
132
Object DetectionPASCAL VOC Set 2 (novel)--
110
Object DetectionPASCAL VOC (Novel Set 1)
AP50 (shot=1)54.5
71
Object DetectionPASCAL VOC Set 3 (novel)
AP50 (shot=1)48.4
71
Few-shot Object DetectionPascal VOC
mAP58.6
65
Object DetectionPascal VOC (Novel Split 2)
nAP5050.7
65
Object DetectionPascal VOC (Novel Split 3)
AP5059.6
65
Object DetectionPascal-5i 2010 (Novel Split 1)
nAP5065.7
54
Object DetectionCOCO-FSOD 30-shot COCO-20
nAP26.8
47
Few-shot Object DetectionMS-COCO 10-shot (novel classes)
nAP19
34
Showing 10 of 18 rows

Other info

Code

Follow for update