Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Zero-Shot Co-salient Object Detection Framework

About

Co-salient Object Detection (CoSOD) endeavors to replicate the human visual system's capacity to recognize common and salient objects within a collection of images. Despite recent advancements in deep learning models, these models still rely on training with well-annotated CoSOD datasets. The exploration of training-free zero-shot CoSOD frameworks has been limited. In this paper, taking inspiration from the zero-shot transfer capabilities of foundational computer vision models, we introduce the first zero-shot CoSOD framework that harnesses these models without any training process. To achieve this, we introduce two novel components in our proposed framework: the group prompt generation (GPG) module and the co-saliency map generation (CMP) module. We evaluate the framework's performance on widely-used datasets and observe impressive results. Our approach surpasses existing unsupervised methods and even outperforms fully supervised methods developed before 2020, while remaining competitive with some fully supervised methods developed before 2022.

Haoke Xiao, Lv Tang, Bo Li, Zhiming Luo, Shaozi Li• 2023

Related benchmarks

TaskDatasetResultRank
Co-Salient Object DetectionCoCA v1 (test)
Mean Absolute Error (MAE)0.115
11
Co-Salient Object DetectionCoSal 2015 v1 (test)
Mean Absolute Error (MAE)10.1
11
Co-Salient Object DetectionCoSOD3k v1 (test)
MAE11.7
11
Showing 3 of 3 rows

Other info

Follow for update