Towards Robust Driving Perception: A Flexible Scale-Driven Family for Self-Supervised Monocular Depth Estimation
About
Self-Supervised Monocular Depth Estimation (MDE) has garnered attention in recent years due to its independence from ground truth. However, most existing models are limited to a single scale and exhibit considerable performance degradation in complex driving environments. Networks specifically designed to handle dynamic traffic participants tend to be overly complex, hindering their deployment on resource-constrained automotive edge devices. To address these limitations and move towards robust driving perception, we propose FlexDepth, a scale-driven and flexible family of self-supervised MDE models tailored for challenging road scenarios. FlexDepth employs a two-stage static-dynamic decoupled training strategy, enabling the independent assessment of confidence for both static backgrounds and dynamic road objects. Furthermore, it introduces a meticulously designed Scale-Driven Decoder (SDD) to dynamically select components based on scale size, facilitating efficient feature fusion and the output of high-precision depth maps. Extensive experiments on standard driving benchmarks demonstrate that without any auxiliary information, our model achieves state-of-the-art performance across arbitrary scales with minimal computational overhead. Our smallest model, Flex-Nano, requires only 0.7 GFLOPs and achieves 37.6 FPS on mobile platforms, ensuring reliable real-time perception while maintaining excellent zero-shot generalization. Our source code is avalible: https://github.com/startnew/flexdepth
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Monocular Depth Estimation | KITTI (Eigen) | Abs Rel0.063 | 552 | |
| Monocular Depth Estimation | Make3D (test) | Abs Rel0.279 | 143 | |
| Monocular Depth Estimation | DDAD (test) | -- | 122 | |
| Monocular Depth Estimation | KITTI Improved GT (Eigen) | AbsRel0.063 | 116 | |
| Monocular Depth Estimation | Cityscapes (test) | RMSE5.268 | 31 | |
| Monocular Depth Estimation | Cityscapes dynamic object regions (test) | Abs Rel0.091 | 18 | |
| Depth Estimation | Cityscapes Static region (test) | Absolute Relative Error0.085 | 4 | |
| Monocular Depth Estimation | Cityscapes v1.0 (test) | AbsRel0.129 | 2 |