Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Dense Relation Distillation with Context-aware Aggregation for Few-Shot Object Detection

About

Conventional deep learning based methods for object detection require a large amount of bounding box annotations for training, which is expensive to obtain such high quality annotated data. Few-shot object detection, which learns to adapt to novel classes with only a few annotated examples, is very challenging since the fine-grained feature of novel object can be easily overlooked with only a few data available. In this work, aiming to fully exploit features of annotated novel object and capture fine-grained features of query object, we propose Dense Relation Distillation with Context-aware Aggregation (DCNet) to tackle the few-shot detection problem. Built on the meta-learning based framework, Dense Relation Distillation module targets at fully exploiting support features, where support features and query feature are densely matched, covering all spatial locations in a feed-forward fashion. The abundant usage of the guidance information endows model the capability to handle common challenges such as appearance changes and occlusions. Moreover, to better capture scale-aware features, Context-aware Aggregation module adaptively harnesses features from different scales for a more comprehensive feature representation. Extensive experiments illustrate that our proposed approach achieves state-of-the-art results on PASCAL VOC and MS COCO datasets. Code will be made available at https://github.com/hzhupku/DCNet.

Hanzhe Hu, Shuai Bai, Aoxue Li, Jinshi Cui, Liwei Wang• 2021

Related benchmarks

TaskDatasetResultRank
Object DetectionPASCAL VOC (Novel Set 1)
mAP@5059.6
223
Object DetectionPASCAL VOC Novel Set 3
mAP@0.550.7
175
Object DetectionPASCAL VOC Novel Set 3 2007+2012
mAP5050.7
139
Object DetectionMS COCO novel classes
nAP18.6
132
Object DetectionMS COCO novel classes 2017 (val)
AP18.6
123
Object DetectionPASCAL VOC Set 2 (novel)
AP5046.6
110
Object DetectionPASCAL VOC 2007+2012 (Novel Set 1)--
75
Object DetectionPASCAL VOC Novel Set 2 2007+2012--
75
Object DetectionPASCAL VOC Set 3 (novel)
AP50 (shot=1)32.3
71
Object DetectionPASCAL VOC (Novel Set 1)
AP50 (shot=1)33.9
71
Showing 10 of 14 rows

Other info

Follow for update