Object Discovery From a Single Unlabeled Image by Mining Frequent Itemset With Multi-scale Features
About
TThe goal of our work is to discover dominant objects in a very general setting where only a single unlabeled image is given. This is far more challenge than typical co-localization or weakly-supervised localization tasks. To tackle this problem, we propose a simple but effective pattern mining-based method, called Object Location Mining (OLM), which exploits the advantages of data mining and feature representation of pre-trained convolutional neural networks (CNNs). Specifically, we first convert the feature maps from a pre-trained CNN model into a set of transactions, and then discovers frequent patterns from transaction database through pattern mining techniques. We observe that those discovered patterns, i.e., co-occurrence highlighted regions, typically hold appearance and spatial consistency. Motivated by this observation, we can easily discover and localize possible objects by merging relevant meaningful patterns. Extensive experiments on a variety of benchmarks demonstrate that OLM achieves competitive localization performance compared with the state-of-the-art methods. We also evaluate our approach compared with unsupervised saliency detection methods and achieves competitive results on seven benchmark datasets. Moreover, we conduct experiments on fine-grained classification to show that our proposed method can locate the entire object and parts accurately, which can benefit to improving the classification results significantly.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Unsupervised single object discovery | VOC 2007 (test) | CorLoc46.2 | 34 | |
| Unsupervised single object discovery | VOC 2012 (test) | CorLoc50.5 | 34 | |
| Unsupervised single object discovery | COCO20K 2014 (train) | CorLoc34.8 | 33 | |
| Single-object discovery | PASCAL VOC 2007 (trainval) | CorLoc46.2 | 26 | |
| Object Discovery | PASCAL VOC 12 (trainval) | CorLoc50.5 | 19 | |
| Object Discovery | COCO 20k 2014 (train val) | CorLoc34.8 | 19 | |
| Object Discovery | PASCAL VOC 07 (trainval) | CorLoc46.2 | 18 | |
| Single-object discovery | COCO 20k | CorLoc34.8 | 18 | |
| Unsupervised single object discovery | COCO 20K 2014 2017 (train) | CorLoc34.8 | 15 | |
| Unsupervised single object discovery | VOC 2012 (trainval) | CorLoc50.5 | 14 |