Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

UniDAC: Universal Metric Depth Estimation for Any Camera

About

Monocular metric depth estimation (MMDE) is a core challenge in computer vision, playing a pivotal role in real-world applications that demand accurate spatial understanding. Although prior works have shown promising zero-shot performance in MMDE, they often struggle with generalization across diverse camera types, such as fisheye and $360^\circ$ cameras. Recent advances have addressed this through unified camera representations or canonical representation spaces, but they require either including large-FoV camera data during training or separately trained models for different domains. We propose UniDAC, an MMDE framework that presents universal robustness in all domains and generalizes across diverse cameras using a single model. We achieve this by decoupling metric depth estimation into relative depth prediction and spatially varying scale estimation, enabling robust performance across different domains. We propose a lightweight Depth-Guided Scale Estimation module that upsamples a coarse scale map to high resolution using the relative depth map as guidance to account for local scale variations. Furthermore, we introduce RoPE-$\phi$, a distortion-aware positional embedding that respects the spatial warping in Equi-Rectangular Projections (ERP) via latitude-aware weighting. UniDAC achieves state of the art (SoTA) in cross-camera generalization by consistently outperforming prior methods across all datasets.

Girish Chandar Ganesan, Yuliang Guo, Liu Ren, Xiaoming Liu• 2026

Related benchmarks

TaskDatasetResultRank
Depth EstimationMatterport3D
delta174.5
50
Depth EstimationPano3D GibsonV2
Absolute Relative Error0.161
24
Monocular Metric Depth EstimationScanNet++
δ191.8
6
Monocular Metric Depth EstimationKITTI-360
δ1 Acc83.6
6
Monocular Depth EstimationScanNet++ zero-shot
δ1 Accuracy91.8
5
Monocular Depth EstimationKITTI-360 zero-shot
Delta 1 Accuracy (δ1) (zero-shot)83.6
5
Monocular Depth EstimationPano3D zero-shot GV2
δ1 Accuracy76.8
5
Showing 7 of 7 rows

Other info

Follow for update