Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Progressively Guided Alternate Refinement Network for RGB-D Salient Object Detection

About

In this paper, we aim to develop an efficient and compact deep network for RGB-D salient object detection, where the depth image provides complementary information to boost performance in complex scenarios. Starting from a coarse initial prediction by a multi-scale residual block, we propose a progressively guided alternate refinement network to refine it. Instead of using ImageNet pre-trained backbone network, we first construct a lightweight depth stream by learning from scratch, which can extract complementary features more efficiently with less redundancy. Then, different from the existing fusion based methods, RGB and depth features are fed into proposed guided residual (GR) blocks alternately to reduce their mutual degradation. By assigning progressive guidance in the stacked GR blocks within each side-output, the false detection and missing parts can be well remedied. Extensive experiments on seven benchmark datasets demonstrate that our model outperforms existing state-of-the-art approaches by a large margin, and also shows superiority in efficiency (71 FPS) and model size (64.9 MB).

Shuhan Chen, Yun Fu• 2020

Related benchmarks

TaskDatasetResultRank
RGB-D Salient Object DetectionSTERE
S-measure (Sα)0.907
198
RGB-D Salient Object DetectionNJU2K (test)
S-measure (Sα)0.909
137
RGB-D Salient Object DetectionSIP
S-measure (Sα)0.876
124
RGB-D Salient Object DetectionLFSD
S-measure (Sα)85.3
122
RGBD Saliency DetectionDES
S-measure0.913
102
RGB-D Salient Object DetectionRGBD135
S-measure (Sα)0.886
92
RGBD Saliency DetectionNLPR
S-measure0.93
85
Salient Object DetectionNLPR (test)
F-beta88.3
76
Saliency DetectionNJUD (test)
MAE0.042
68
RGB-D Saliency DetectionNLPR
Max F-beta0.916
65
Showing 10 of 23 rows

Other info

Code

Follow for update