Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Empowering Feed-Forward Reconstruction Models with Metric Scale via Satellite Images

About

Feed-forward 3D reconstruction models have recently shown strong generalization across diverse scenes, yet most of them recover geometry only up to an unknown global scale. This scale ambiguity limits their use in applications that require metric understanding of the environment. Existing metric reconstruction methods commonly rely on large-scale metric annotations or accurate camera calibration, both of which are costly or unreliable in many real-world settings. We propose a satellite-guided framework for resolving scale ambiguity in feed-forward 3D reconstruction. The key idea is to use readily available satellite imagery as a global metric reference. Given a coarse camera pose, our method retrieves a local satellite patch and integrates it with a feed-forward reconstruction backbone through bidirectional cross-view interaction. By enforcing consistency between the reconstructed scene and the satellite reference, the model infers absolute scale, refines scene geometry, and estimates camera pose in a metric coordinate frame. Experiments on KITTI, nuScenes, and Oxford RobotCar show consistent improvements in metric depth estimation, multi-view point-cloud reconstruction, and cross-view camera localization, while preserving strong generalization across datasets and geographic regions.

Xianghui Ze, Yongjian Luo, Mengjun Chao, Zhenbo Song, Jianfeng Lu, Yujiao Shi• 2026

Related benchmarks

TaskDatasetResultRank
Monocular Depth EstimationKITTI
AbsRel13.71
33
Multi-view Depth EstimationKITTI
Absolute Relative Error (Rel)0.0353
16
Location EstimationOxford RobotCar (test1)
Mean Position Error (m)1.02
8
Location EstimationOxford RobotCar (Test3)
Mean Position Error (m)1.08
8
Multi-view point-cloud estimationnuScenes
Accuracy Mean1.3632
8
3-DoF Pose EstimationKITTI Same-area
Location Mean Error (m)0.73
7
3-DoF Pose EstimationKITTI Cross-area
Location Mean Error (m)5.75
7
Location EstimationOxford RobotCar (test)
Mean Position Error1.09
5
Location EstimationOxford RobotCar (Overall)
Mean Position Error1.07
5
Showing 9 of 9 rows

Other info

Follow for update