The Fourth Monocular Depth Estimation Challenge
About
This paper presents the results of the fourth edition of the Monocular Depth Estimation Challenge (MDEC), which focuses on zero-shot generalization to the SYNS-Patches benchmark, a dataset featuring challenging environments in both natural and indoor settings. In this edition, we revised the evaluation protocol to use least-squares alignment with two degrees of freedom to support disparity and affine-invariant predictions. We also revised the baselines and included popular off-the-shelf methods: Depth Anything v2 and Marigold. The challenge received a total of 24 submissions that outperformed the baselines on the test set; 10 of these included a report describing their approach, with most leading methods relying on affine-invariant predictions. The challenge winners improved the 3D F-Score over the previous edition's best result, raising it from 22.58% to 23.05%.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Monocular Depth Estimation | Pano3D zero-shot GV2 | δ1 Accuracy37.8 | 19 | |
| Monocular Depth Estimation | Perspective Average of KITTI, NYU-v2, IBims-1 | Delta 1 Accuracy87.8 | 14 | |
| Monocular Depth Estimation | ScanNet++ Fisheye | delta1 Accuracy62.1 | 14 |