Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Multi-Scale Positive Sample Refinement for Few-Shot Object Detection

About

Few-shot object detection (FSOD) helps detectors adapt to unseen classes with few training instances, and is useful when manual annotation is time-consuming or data acquisition is limited. Unlike previous attempts that exploit few-shot classification techniques to facilitate FSOD, this work highlights the necessity of handling the problem of scale variations, which is challenging due to the unique sample distribution. To this end, we propose a Multi-scale Positive Sample Refinement (MPSR) approach to enrich object scales in FSOD. It generates multi-scale positive samples as object pyramids and refines the prediction at various scales. We demonstrate its advantage by integrating it as an auxiliary branch to the popular architecture of Faster R-CNN with FPN, delivering a strong FSOD solution. Several experiments are conducted on PASCAL VOC and MS COCO, and the proposed approach achieves state of the art results and significantly outperforms other counterparts, which shows its effectiveness. Code is available at https://github.com/jiaxi-wu/MPSR.

Jiaxi Wu, Songtao Liu, Di Huang, Yunhong Wang• 2020

Related benchmarks

TaskDatasetResultRank
Object DetectionPASCAL VOC (Novel Set 1)
mAP@5061.8
223
Object DetectionCOCO (minival)
mAP14.1
184
Object DetectionPASCAL VOC Novel Set 3
mAP@0.551.3
175
Object DetectionMS-COCO (val)
mAP0.141
138
Object DetectionMS COCO novel classes
nAP1.41e+3
132
Object DetectionMS COCO novel classes 2017 (val)
AP14.1
123
Object DetectionPASCAL VOC Set 2 (novel)
AP5047
110
Object DetectionPASCAL VOC Novel Set 2
mAP47.8
100
Generalized Few-Shot Object DetectionPASCAL VOC (Set 2)
AP5066.3
90
Generalized Few-Shot Object DetectionPASCAL VOC All Set 1 (test)
AP5069
90
Showing 10 of 44 rows

Other info

Code

Follow for update