Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Seeing Across Skies and Streets: Feedforward 3D Reconstruction from Satellite, Drone, and Ground Images

About

Cross-view localization classically asks: where does this ground image lie on the satellite tile? Existing methods are typically limited to 3-DoF estimates -- an $(x,y)$ position and a yaw angle -- because nadir satellite imagery provides no direct cues for roll, pitch, or altitude, forcing a reliance on planar-motion and zero-tilt assumptions. These assumptions break on real terrain with slopes, ramps, and tilted camera mounts. To overcome this, we introduce a single UAV image as an intermediate viewpoint: it reveals the 3D structure invisible from nadir, supplies the cues for roll, pitch, and altitude that the satellite alone cannot provide, and needs only spatial overlap with the ground camera -- no known relative pose is required. Building on this insight, we propose **Cross3R**, a flexible feed-forward model that ingests a satellite tile together with a UAV image, a ground image, or both, and, in a single forward pass, recovers a cross-view 3D point cloud, the 6-DoF poses of every input camera, and the on-tile $(x,y)$ position and yaw of each perspective camera. For training and evaluation, we also construct **CrossGeo**, a 278K-image tri-view dataset spanning 85 scenes across every continent except Antarctica. On CrossGeo, Cross3R consistently outperforms feed-forward 3D baselines in point-cloud reconstruction, 6-DoF camera-pose estimation, and cross-view localization. On KITTI, it outperforms dedicated cross-view methods trained on KITTI on most metrics, despite having no KITTI training itself.

Qiwei Wang, Zhongyao Tuo, Xianghui Ze, Yujiao Shi• 2026

Related benchmarks

TaskDatasetResultRank
Cross-view ground-camera localizationKITTI 2 (test)
Pos. Error (m) Mean11.69
6
Cross-view LocalizationCrossGeo Ground Camera 1.0 (test)
Mean Distance (m)3.68
5
Cross-view LocalizationCrossGeo UAV Camera 1.0 (test)
Mean Distance Error (m)2.38
5
Ground Camera LocalizationAnyVisLoc
Mean Translation Error (Meter)10.49
5
UAV Camera LocalizationAnyVisLoc
Mean Translation Error (m)14.51
5
Camera pose estimationCrossGeo
Mean Accuracy1.0671
5
Showing 6 of 6 rows

Other info

Follow for update