Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

BridgeDepth: Bridging Monocular and Stereo Reasoning with Latent Alignment

About

Monocular and stereo depth estimation offer complementary strengths: monocular methods capture rich contextual priors but lack geometric precision, while stereo approaches leverage epipolar geometry yet struggle with ambiguities such as reflective or textureless surfaces. Despite post-hoc synergies, these paradigms remain largely disjoint in practice. We introduce a unified framework that bridges both through iterative bidirectional alignment of their latent representations. At its core, a novel cross-attentive alignment mechanism dynamically synchronizes monocular contextual cues with stereo hypothesis representations during stereo reasoning. This mutual alignment resolves stereo ambiguities (e.g., specular surfaces) by injecting monocular structure priors while refining monocular depth with stereo geometry within a single network. Extensive experiments demonstrate state-of-the-art results: \textbf{it reduces zero-shot generalization error by $\!>\!40\%$ on Middlebury and ETH3D}, while addressing longstanding failures on transparent and reflective surfaces. By harmonizing multi-view geometry with monocular context, our approach enables robust 3D perception that transcends modality-specific limitations. Codes available at https://github.com/aeolusguan/BridgeDepth.

Tongfan Guan, Jiaxin Guo, Chen Wang, Yun-Hui Liu• 2025

Related benchmarks

TaskDatasetResultRank
Stereo MatchingKITTI 2015 (test)
D1 Error (Overall)1.4
205
Stereo MatchingKITTI 2015--
118
Stereo MatchingKITTI 2012
Error Rate (3px, All)4.04
108
Stereo MatchingKITTI 2012 (test)--
89
Stereo MatchingETH3D
Threshold Error > 1px (Noc)1.07
50
Stereo MatchingMiddlebury (test)--
47
Stereo MatchingETH3D (test)--
34
Stereo MatchingBooster Q
EPE1.96
33
Stereo MatchingMiddlebury 2021
Bad Pixel Rate (Thresh > 2.0, All)13.66
24
Stereo MatchingMidd-T H
EPE (All Pixels)0.74
13
Showing 10 of 12 rows

Other info

Follow for update