Adaptive Graph Convolutional Network with Attention Graph Clustering for Co-saliency Detection
About
Co-saliency detection aims to discover the common and salient foregrounds from a group of relevant images. For this task, we present a novel adaptive graph convolutional network with attention graph clustering (GCAGC). Three major contributions have been made, and are experimentally shown to have substantial practical merits. First, we propose a graph convolutional network design to extract information cues to characterize the intra- and interimage correspondence. Second, we develop an attention graph clustering algorithm to discriminate the common objects from all the salient foreground objects in an unsupervised fashion. Third, we present a unified framework with encoder-decoder structure to jointly train and optimize the graph convolutional network, attention graph cluster, and co-saliency detection decoder in an end-to-end manner. We evaluate our proposed GCAGC method on three cosaliency detection benchmark datasets (iCoseg, Cosal2015 and COCO-SEG). Our GCAGC method obtains significant improvements over the state-of-the-arts on most of them.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Co-Saliency Detection | CoSOD3k (test) | Fmax0.74 | 41 | |
| Co-saliency Object Detection | CoSOD3k | Sm78.5 | 30 | |
| Co-saliency Object Detection | CoSal 2015 | Sm0.822 | 27 | |
| Co-Salient Object Detection | iCoseg | E-measure (E_phi)89.7 | 19 | |
| Co-Saliency Detection | CoSal 2015 (test) | Emax86.6 | 18 | |
| Co-Saliency Detection | CoCA (test) | Emax75.4 | 17 | |
| Co-Salient Object Detection | CoSal 2015 | MAE0.085 | 10 | |
| Co-Salient Object Detection | CoCA | MAE0.111 | 9 |