Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Gradient-Induced Co-Saliency Detection

About

Co-saliency detection (Co-SOD) aims to segment the common salient foreground in a group of relevant images. In this paper, inspired by human behavior, we propose a gradient-induced co-saliency detection (GICD) method. We first abstract a consensus representation for the grouped images in the embedding space; then, by comparing the single image with consensus representation, we utilize the feedback gradient information to induce more attention to the discriminative co-salient features. In addition, due to the lack of Co-SOD training data, we design a jigsaw training strategy, with which Co-SOD networks can be trained on general saliency datasets without extra pixel-level annotations. To evaluate the performance of Co-SOD methods on discovering the co-salient object among multiple foregrounds, we construct a challenging CoCA dataset, where each image contains at least one extraneous foreground along with the co-salient object. Experiments demonstrate that our GICD achieves state-of-the-art performance. Our codes and dataset are available at https://mmcheng.net/gicd/.

Zhao Zhang, Wenda Jin, Jun Xu, Ming-Ming Cheng• 2020

Related benchmarks

TaskDatasetResultRank
Co-Saliency DetectionCoSOD3k (test)
Fmax0.77
41
Co-saliency Object DetectionCoSOD3k
Sm79.7
30
Co-Salient Object DetectionCoCA (test)
Fmax0.513
28
Co-saliency Object DetectionCoSal 2015
Sm0.842
27
Co-Salient Object DetectionCoSal 2015 (test)
Sm84.37
23
Co-Saliency DetectionCoSal 2015 (test)
Emax88.7
18
Co-Saliency DetectionCoCA (test)
Emax71.5
17
RGB-D Co-Salient Object DetectionCoSal1k (test)
S-Measure (Sm)0.793
13
RGB-D Co-Salient Object DetectionCoSal150 (test)
Sm0.821
13
RGB-D Co-Salient Object DetectionCoSal183 (test)
Sm0.661
13
Showing 10 of 16 rows

Other info

Code

Follow for update