Gradient-Induced Co-Saliency Detection
About
Co-saliency detection (Co-SOD) aims to segment the common salient foreground in a group of relevant images. In this paper, inspired by human behavior, we propose a gradient-induced co-saliency detection (GICD) method. We first abstract a consensus representation for the grouped images in the embedding space; then, by comparing the single image with consensus representation, we utilize the feedback gradient information to induce more attention to the discriminative co-salient features. In addition, due to the lack of Co-SOD training data, we design a jigsaw training strategy, with which Co-SOD networks can be trained on general saliency datasets without extra pixel-level annotations. To evaluate the performance of Co-SOD methods on discovering the co-salient object among multiple foregrounds, we construct a challenging CoCA dataset, where each image contains at least one extraneous foreground along with the co-salient object. Experiments demonstrate that our GICD achieves state-of-the-art performance. Our codes and dataset are available at https://mmcheng.net/gicd/.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Co-Saliency Detection | CoSOD3k (test) | Fmax0.77 | 41 | |
| Co-saliency Object Detection | CoSOD3k | Sm79.7 | 30 | |
| Co-Salient Object Detection | CoCA (test) | Fmax0.513 | 28 | |
| Co-saliency Object Detection | CoSal 2015 | Sm0.842 | 27 | |
| Co-Salient Object Detection | CoSal 2015 (test) | Sm84.37 | 23 | |
| Co-Saliency Detection | CoSal 2015 (test) | Emax88.7 | 18 | |
| Co-Saliency Detection | CoCA (test) | Emax71.5 | 17 | |
| RGB-D Co-Salient Object Detection | CoSal1k (test) | S-Measure (Sm)0.793 | 13 | |
| RGB-D Co-Salient Object Detection | CoSal150 (test) | Sm0.821 | 13 | |
| RGB-D Co-Salient Object Detection | CoSal183 (test) | Sm0.661 | 13 |