Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Large-Scale Unsupervised Object Discovery

About

Existing approaches to unsupervised object discovery (UOD) do not scale up to large datasets without approximations that compromise their performance. We propose a novel formulation of UOD as a ranking problem, amenable to the arsenal of distributed methods available for eigenvalue problems and link analysis. Through the use of self-supervised features, we also demonstrate the first effective fully unsupervised pipeline for UOD. Extensive experiments on COCO and OpenImages show that, in the single-object discovery setting where a single prominent object is sought in each image, the proposed LOD (Large-scale Object Discovery) approach is on par with, or better than the state of the art for medium-scale datasets (up to 120K images), and over 37% better than the only other algorithms capable of scaling up to 1.7M images. In the multi-object discovery setting where multiple objects are sought in each image, the proposed LOD is over 14% better in average precision (AP) than all other methods for datasets ranging from 20K to 1.7M images. Using self-supervised features, we also show that the proposed method obtains state-of-the-art UOD performance on OpenImages. Our code is publicly available at https://github.com/huyvvo/LOD.

Huy V. Vo, Elena Sizikova, Cordelia Schmid, Patrick P\'erez, Jean Ponce• 2021

Related benchmarks

TaskDatasetResultRank
Object DetectionVOC 2007 (test)--
52
Unsupervised single object discoveryVOC 2007 (test)
CorLoc56.3
34
Unsupervised single object discoveryVOC 2012 (test)
CorLoc61.6
34
Unsupervised single object discoveryCOCO20K 2014 (train)
CorLoc52.7
33
Single-object discoveryPASCAL VOC 2007 (trainval)
CorLoc56.3
26
Object DiscoveryPASCAL VOC 12 (trainval)
CorLoc55.1
19
Object DiscoveryCOCO 20k 2014 (train val)
CorLoc48.5
19
Single-object discoveryCOCO 20k
CorLoc52.7
18
Object DiscoveryPASCAL VOC 07 (trainval)
CorLoc53.6
18
Unsupervised single object discoveryCOCO 20K 2014 2017 (train)
CorLoc48.5
15
Showing 10 of 34 rows

Other info

Code

Follow for update