Unsupervised Image Matching and Object Discovery as Optimization
About
Learning with complete or partial supervision is powerful but relies on ever-growing human annotation efforts. As a way to mitigate this serious problem, as well as to serve specific applications, unsupervised learning has emerged as an important field of research. In computer vision, unsupervised learning comes in various guises. We focus here on the unsupervised discovery and matching of object categories among images in a collection, following the work of Cho et al. 2015. We show that the original approach can be reformulated and solved as a proper optimization problem. Experiments on several benchmarks establish the merit of our approach.
Huy V. Vo, Francis Bach, Minsu Cho, Kai Han, Yann LeCun, Patrick Perez, Jean Ponce• 2019
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Unsupervised Object Discovery | VOC 2007 (train+val) | CorLoc40.7 | 13 | |
| Image graph retrieval | VOC all 2007 (trainval) | CorRet47.9 | 12 | |
| Image graph retrieval | VOC 12 (trainval) | CorRet49.2 | 12 | |
| Single-object Colocalization | OD | CorLoc87.1 | 10 | |
| Image graph retrieval | COCO 20k | CorRet43.6 | 8 | |
| Single-object Colocalization | VOC all 2007 | CorLoc39.5 | 6 | |
| Single-object Colocalization | VOC_6x2 2007 | CorLoc71.2 | 5 | |
| Object Discovery | VOC all (mixed) | CorLoc39.8 | 4 | |
| Object Discovery | OD (Rubinstein) (mixed) | CorLoc83 | 3 | |
| Object Discovery | VOC 6x2 (mixed) | CorLoc60.2 | 3 |
Showing 10 of 10 rows