Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CuVLER: Enhanced Unsupervised Object Discoveries through Exhaustive Self-Supervised Transformers

About

In this paper, we introduce VoteCut, an innovative method for unsupervised object discovery that leverages feature representations from multiple self-supervised models. VoteCut employs normalized-cut based graph partitioning, clustering and a pixel voting approach. Additionally, We present CuVLER (Cut-Vote-and-LEaRn), a zero-shot model, trained using pseudo-labels, generated by VoteCut, and a novel soft target loss to refine segmentation accuracy. Through rigorous evaluations across multiple datasets and several unsupervised setups, our methods demonstrate significant improvements in comparison to previous state-of-the-art models. Our ablation studies further highlight the contributions of each component, revealing the robustness and efficacy of our approach. Collectively, VoteCut and CuVLER pave the way for future advancements in image segmentation.

Shahaf Arica, Or Rubin, Sapir Gershov, Shlomi Laufer• 2024

Related benchmarks

TaskDatasetResultRank
Semantic segmentationADE20K
mIoU13.3
699
Semantic segmentationCOCO Stuff
mIoU30
421
Semantic segmentationPascal VOC
mIoU0.194
295
Semantic segmentationCOCO Object
mIoU16
147
Semantic segmentationPascal Context
mIoU25.6
62
Semantic segmentationCityscapes
mIoU3.2
41
Category-agnostic object detectionCOCO 20k
AP13.1
8
Category-agnostic object detectionCOCO 2017 (val)
AP0.128
7
Showing 8 of 8 rows

Other info

Follow for update