Label, Verify, Correct: A Simple Few Shot Object Detection Method
About
The objective of this paper is few-shot object detection (FSOD) -- the task of expanding an object detector for a new category given only a few instances for training. We introduce a simple pseudo-labelling method to source high-quality pseudo-annotations from the training set, for each new category, vastly increasing the number of training instances and reducing class imbalance; our method finds previously unlabelled instances. Na\"ively training with model predictions yields sub-optimal performance; we present two novel methods to improve the precision of the pseudo-labelling process: first, we introduce a verification technique to remove candidate detections with incorrect class labels; second, we train a specialised model to correct poor quality bounding boxes. After these two novel steps, we obtain a large set of high-quality pseudo-annotations that allow our final detector to be trained end-to-end. Additionally, we demonstrate our method maintains base class performance, and the utility of simple augmentations in FSOD. While benchmarking on PASCAL VOC and MS-COCO, our method achieves state-of-the-art or second-best performance compared to existing approaches across all number of shots.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Object Detection | MS COCO novel classes | nAP2.45e+3 | 132 | |
| Object Detection | PASCAL VOC Set 2 (novel) | -- | 110 | |
| Object Detection | PASCAL VOC (Novel Set 1) | AP50 (shot=1)54.5 | 71 | |
| Object Detection | PASCAL VOC Set 3 (novel) | AP50 (shot=1)48.4 | 71 | |
| Few-shot Object Detection | Pascal VOC | mAP58.6 | 65 | |
| Object Detection | Pascal VOC (Novel Split 2) | nAP5050.7 | 65 | |
| Object Detection | Pascal VOC (Novel Split 3) | AP5059.6 | 65 | |
| Object Detection | Pascal-5i 2010 (Novel Split 1) | nAP5065.7 | 54 | |
| Object Detection | COCO-FSOD 30-shot COCO-20 | nAP26.8 | 47 | |
| Few-shot Object Detection | MS-COCO 10-shot (novel classes) | nAP19 | 34 |