Geometry-Aware Symmetric Domain Adaptation for Monocular Depth Estimation
About
Supervised depth estimation has achieved high accuracy due to the advanced deep network architectures. Since the groundtruth depth labels are hard to obtain, recent methods try to learn depth estimation networks in an unsupervised way by exploring unsupervised cues, which are effective but less reliable than true labels. An emerging way to resolve this dilemma is to transfer knowledge from synthetic images with ground truth depth via domain adaptation techniques. However, these approaches overlook specific geometric structure of the natural images in the target domain (i.e., real data), which is important for high-performing depth prediction. Motivated by the observation, we propose a geometry-aware symmetric domain adaptation framework (GASDA) to explore the labels in the synthetic data and epipolar geometry in the real data jointly. Moreover, by training two image style translators and depth estimators symmetrically in an end-to-end network, our model achieves better image style transfer and generates high-quality depth maps. The experimental results demonstrate the effectiveness of our proposed method and comparable performance against the state-of-the-art. Code will be publicly available at: https://github.com/sshan-zhao/GASDA.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Monocular Depth Estimation | Make3D (test) | Abs Rel0.403 | 132 | |
| Monocular Depth Estimation | KITTI 80m maximum depth (Eigen) | Abs Rel0.149 | 126 | |
| Depth Estimation | KITTI 50m cap (test) | Abs Rel0.143 | 24 | |
| Monocular Depth Estimation | KITTI Raw (KR) Eigen 80m (test) | Abs Rel Error0.12 | 20 | |
| Monocular Depth Estimation | KITTI 50m cap Eigen split (test) | Absolute Relative Error0.143 | 19 | |
| Monocular Depth Estimation | KITTI capped 50m 15 (Eigen) | Abs Rel0.143 | 19 | |
| Depth Estimation | KITTI Eigen split 80m cap | Abs Rel Error0.149 | 18 | |
| Monocular Depth Estimation | KITTI Stereo 2015 (test) | Abs Rel0.106 | 9 | |
| Monocular Depth Estimation | KITTI stereo 2015 (train) | Abs Rel0.106 | 4 |