Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Cross-Domain Weakly-Supervised Object Detection through Progressive Domain Adaptation

About

Can we detect common objects in a variety of image domains without instance-level annotations? In this paper, we present a framework for a novel task, cross-domain weakly supervised object detection, which addresses this question. For this paper, we have access to images with instance-level annotations in a source domain (e.g., natural image) and images with image-level annotations in a target domain (e.g., watercolor). In addition, the classes to be detected in the target domain are all or a subset of those in the source domain. Starting from a fully supervised object detector, which is pre-trained on the source domain, we propose a two-step progressive domain adaptation technique by fine-tuning the detector on two types of artificially and automatically generated samples. We test our methods on our newly collected datasets containing three image domains, and achieve an improvement of approximately 5 to 20 percentage points in terms of mean average precision (mAP) compared to the best-performing baselines.

Naoto Inoue, Ryosuke Furuta, Toshihiko Yamasaki, Kiyoharu Aizawa• 2018

Related benchmarks

TaskDatasetResultRank
Object DetectionWatercolor2k (test)
mAP (Overall)77.3
113
Object DetectionFoggy Cityscapes (test)
mAP (Mean Average Precision)31.5
108
Object DetectionClipart1k (test)
mAP76.2
70
Object DetectionComic2k (test)
mAP70.1
62
Object DetectionKITTI → Cityscapes (test)
AP (Car)40.7
62
Object DetectionCityscapes to Foggy Cityscapes (val)
mAP31.5
57
Object DetectionClipart (test)
mAP47.1
22
Object DetectionWatercolor (test)
Bike Prediction Error81
17
Object DetectionClipart all
AP (aero)50.1
12
Object DetectionComic (test)
Bike Error (Eperf)53
12
Showing 10 of 12 rows

Other info

Code

Follow for update