Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Depth Any Panoramas: A Foundation Model for Panoramic Depth Estimation

About

In this work, we present a panoramic metric depth foundation model that generalizes across diverse scene distances. We explore a data-in-the-loop paradigm from the view of both data construction and framework design. We collect a large-scale dataset by combining public datasets, high-quality synthetic data from our UE5 simulator and text-to-image models, and real panoramic images from the web. To reduce domain gaps between indoor/outdoor and synthetic/real data, we introduce a three-stage pseudo-label curation pipeline to generate reliable ground truth for unlabeled images. For the model, we adopt DINOv3-Large as the backbone for its strong pre-trained generalization, and introduce a plug-and-play range mask head, sharpness-centric optimization, and geometry-centric optimization to improve robustness to varying distances and enforce geometric consistency across views. Experiments on multiple benchmarks (e.g., Stanford2D3D, Matterport3D, and Deep360) demonstrate strong performance and zero-shot generalization, with particularly robust and stable metric predictions in diverse real-world scenes. The project page can be found at: \href{https://insta360-research-team.github.io/DAP_website/} {https://insta360-research-team.github.io/DAP\_website/}

Xin Lin, Meixi Song, Dizhe Zhang, Wenxuan Lu, Haodong Li, Bo Du, Ming-Hsuan Yang, Truong Nguyen, Lu Qi• 2025

Related benchmarks

TaskDatasetResultRank
Monocular Depth EstimationStanford2D3D (test)
δ1 Accuracy95.64
86
Depth EstimationMatterport3D
delta185.18
53
Depth EstimationStanford2D3D
Abs Rel9.76
51
Monocular Depth EstimationPanoSunCG
Delta Threshold Accuracy (< 1.25)94.84
29
Monocular Depth EstimationRealsee3D Synthetic
AbsRel0.113
24
Monocular Depth EstimationRealsee3D (Real)
AbsRel0.422
24
Depth EstimationStructure3D (test)
AbsRel0.0341
18
Monocular Depth EstimationStanford2D3D (unseen)
AbsRel24.9
17
Monocular Depth EstimationMatterport3D (unseen)
AbsRel39.7
17
Depth EstimationRealsee Real-World
AbsRel0.144
14
Showing 10 of 24 rows

Other info

GitHub

Follow for update