Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimation

About

Self-supervised learning has shown very promising results for monocular depth estimation. Scene structure and local details both are significant clues for high-quality depth estimation. Recent works suffer from the lack of explicit modeling of scene structure and proper handling of details information, which leads to a performance bottleneck and blurry artefacts in predicted results. In this paper, we propose the Channel-wise Attention-based Depth Estimation Network (CADepth-Net) with two effective contributions: 1) The structure perception module employs the self-attention mechanism to capture long-range dependencies and aggregates discriminative features in channel dimensions, explicitly enhances the perception of scene structure, obtains the better scene understanding and rich feature representation. 2) The detail emphasis module re-calibrates channel-wise feature maps and selectively emphasizes the informative features, aiming to highlight crucial local details information and fuse different level features more efficiently, resulting in more precise and sharper depth prediction. Furthermore, the extensive experiments validate the effectiveness of our method and show that our model achieves the state-of-the-art results on the KITTI benchmark and Make3D datasets.

Jiaxing Yan, Hong Zhao, Penghui Bu, YuSheng Jin• 2021

Related benchmarks

TaskDatasetResultRank
Monocular Depth EstimationKITTI (Eigen)
Abs Rel0.096
502
Monocular Depth EstimationKITTI (Eigen split)
Abs Rel0.096
193
Monocular Depth EstimationKITTI
Abs Rel0.105
161
Monocular Depth EstimationMake3D (test)
Abs Rel0.312
132
Monocular Depth EstimationKITTI 2015 (Eigen split)
Abs Rel0.096
95
Monocular Depth EstimationKITTI improved ground truth (Eigen split)
Abs Rel0.07
65
Monocular Depth EstimationCityscapes
Accuracy (delta < 1.25)86.2
62
Depth PredictionKITTI improved ground truth 2015 (test)
Abs Rel0.07
15
Depth EstimationDrivingStereo Cloudy
AbsRel14.7
14
Depth EstimationDrivingStereo Rainy
AbsRel0.221
14
Showing 10 of 16 rows

Other info

Follow for update