Dense Relation Distillation with Context-aware Aggregation for Few-Shot Object Detection
About
Conventional deep learning based methods for object detection require a large amount of bounding box annotations for training, which is expensive to obtain such high quality annotated data. Few-shot object detection, which learns to adapt to novel classes with only a few annotated examples, is very challenging since the fine-grained feature of novel object can be easily overlooked with only a few data available. In this work, aiming to fully exploit features of annotated novel object and capture fine-grained features of query object, we propose Dense Relation Distillation with Context-aware Aggregation (DCNet) to tackle the few-shot detection problem. Built on the meta-learning based framework, Dense Relation Distillation module targets at fully exploiting support features, where support features and query feature are densely matched, covering all spatial locations in a feed-forward fashion. The abundant usage of the guidance information endows model the capability to handle common challenges such as appearance changes and occlusions. Moreover, to better capture scale-aware features, Context-aware Aggregation module adaptively harnesses features from different scales for a more comprehensive feature representation. Extensive experiments illustrate that our proposed approach achieves state-of-the-art results on PASCAL VOC and MS COCO datasets. Code will be made available at https://github.com/hzhupku/DCNet.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Object Detection | PASCAL VOC (Novel Set 1) | mAP@5059.6 | 223 | |
| Object Detection | PASCAL VOC Novel Set 3 | mAP@0.550.7 | 175 | |
| Object Detection | PASCAL VOC Novel Set 3 2007+2012 | mAP5050.7 | 139 | |
| Object Detection | MS COCO novel classes | nAP18.6 | 132 | |
| Object Detection | MS COCO novel classes 2017 (val) | AP18.6 | 123 | |
| Object Detection | PASCAL VOC Set 2 (novel) | AP5046.6 | 110 | |
| Object Detection | PASCAL VOC 2007+2012 (Novel Set 1) | -- | 75 | |
| Object Detection | PASCAL VOC Novel Set 2 2007+2012 | -- | 75 | |
| Object Detection | PASCAL VOC Set 3 (novel) | AP50 (shot=1)32.3 | 71 | |
| Object Detection | PASCAL VOC (Novel Set 1) | AP50 (shot=1)33.9 | 71 |