Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Group Collaborative Learning for Co-Salient Object Detection

About

We present a novel group collaborative learning framework (GCoNet) capable of detecting co-salient objects in real time (16ms), by simultaneously mining consensus representations at group level based on the two necessary criteria: 1) intra-group compactness to better formulate the consistency among co-salient objects by capturing their inherent shared attributes using our novel group affinity module; 2) inter-group separability to effectively suppress the influence of noisy objects on the output by introducing our new group collaborating module conditioning the inconsistent consensus. To learn a better embedding space without extra computational overhead, we explicitly employ auxiliary classification supervision. Extensive experiments on three challenging benchmarks, i.e., CoCA, CoSOD3k, and Cosal2015, demonstrate that our simple GCoNet outperforms 10 cutting-edge models and achieves the new state-of-the-art. We demonstrate this paper's new technical contributions on a number of important downstream computer vision applications including content aware co-segmentation, co-localization based automatic thumbnails, etc.

Qi Fan, Deng-Ping Fan, Huazhu Fu, Chi Keung Tang, Ling Shao, Yu-Wing Tai• 2021

Related benchmarks

TaskDatasetResultRank
Co-Saliency DetectionCoSOD3k (test)
Fmax0.778
41
Co-saliency Object DetectionCoSOD3k
Sm80.2
30
Co-Salient Object DetectionCoCA (test)
Fmax0.544
28
Co-Salient Object DetectionCoSal 2015 (test)
Sm84.53
23
Co-segmentationPascal
J69.2
14
RGB-D Co-Salient Object DetectionCoSal150 (test)
Sm0.867
13
RGB-D Co-Salient Object DetectionCoSal1k (test)
S-Measure (Sm)0.81
13
RGB-D Co-Salient Object DetectionCoSal183 (test)
Sm0.708
13
CosegmentationiCoseg
Jaccard Index89.7
12
Image Object Co-segmentationInternet
J Score70.5
12
Showing 10 of 13 rows

Other info

Code

Follow for update