Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Strong-Weak Distribution Alignment for Adaptive Object Detection

About

We propose an approach for unsupervised adaptation of object detectors from label-rich to label-poor domains which can significantly reduce annotation costs associated with detection. Recently, approaches that align distributions of source and target images using an adversarial loss have been proven effective for adapting object classifiers. However, for object detection, fully matching the entire distributions of source and target images to each other at the global image level may fail, as domains could have distinct scene layouts and different combinations of objects. On the other hand, strong matching of local features such as texture and color makes sense, as it does not change category level semantics. This motivates us to propose a novel method for detector adaptation based on strong local alignment and weak global alignment. Our key contribution is the weak alignment model, which focuses the adversarial alignment loss on images that are globally similar and puts less emphasis on aligning images that are globally dissimilar. Additionally, we design the strong domain alignment model to only look at local receptive fields of the feature map. We empirically verify the effectiveness of our method on four datasets comprising both large and small domain shifts. Our code is available at \url{https://github.com/VisionLearningGroup/DA_Detection}

Kuniaki Saito, Yoshitaka Ushiku, Tatsuya Harada, Kate Saenko• 2018

Related benchmarks

TaskDatasetResultRank
Object DetectionCityscapes to Foggy Cityscapes (test)
mAP35.3
196
Object DetectionWatercolor2k (test)
mAP (Overall)56.7
113
Object DetectionFoggy Cityscapes (test)
mAP (Mean Average Precision)35.3
108
Object DetectionSim10K → Cityscapes (test)
AP (Car)44.6
104
Object DetectionCityscapes Adaptation from SIM-10k (val)
AP (Car)44.6
97
Object DetectionPASCAL VOC 2007+2012 (test)
mAP (mean Average Precision)84.9
95
Object DetectionPascal VOC -> Clipart (test)
mAP38.1
78
Object DetectionClipart1k (test)
mAP38.1
70
Object DetectionFoggy Cityscapes (val)
mAP34.8
67
Object DetectionPASCAL VOC to Water Color (test)
mAP53.3
64
Showing 10 of 66 rows

Other info

Code

Follow for update