Depth Any Panoramas: A Foundation Model for Panoramic Depth Estimation
About
In this work, we present a panoramic metric depth foundation model that generalizes across diverse scene distances. We explore a data-in-the-loop paradigm from the view of both data construction and framework design. We collect a large-scale dataset by combining public datasets, high-quality synthetic data from our UE5 simulator and text-to-image models, and real panoramic images from the web. To reduce domain gaps between indoor/outdoor and synthetic/real data, we introduce a three-stage pseudo-label curation pipeline to generate reliable ground truth for unlabeled images. For the model, we adopt DINOv3-Large as the backbone for its strong pre-trained generalization, and introduce a plug-and-play range mask head, sharpness-centric optimization, and geometry-centric optimization to improve robustness to varying distances and enforce geometric consistency across views. Experiments on multiple benchmarks (e.g., Stanford2D3D, Matterport3D, and Deep360) demonstrate strong performance and zero-shot generalization, with particularly robust and stable metric predictions in diverse real-world scenes. The project page can be found at: \href{https://insta360-research-team.github.io/DAP_website/} {https://insta360-research-team.github.io/DAP\_website/}
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Monocular Depth Estimation | Stanford2D3D (test) | δ1 Accuracy95.64 | 86 | |
| Depth Estimation | Matterport3D | delta185.18 | 53 | |
| Depth Estimation | Stanford2D3D | Abs Rel9.76 | 51 | |
| Monocular Depth Estimation | PanoSunCG | Delta Threshold Accuracy (< 1.25)94.84 | 29 | |
| Monocular Depth Estimation | Realsee3D Synthetic | AbsRel0.113 | 24 | |
| Monocular Depth Estimation | Realsee3D (Real) | AbsRel0.422 | 24 | |
| Depth Estimation | Structure3D (test) | AbsRel0.0341 | 18 | |
| Monocular Depth Estimation | Stanford2D3D (unseen) | AbsRel24.9 | 17 | |
| Monocular Depth Estimation | Matterport3D (unseen) | AbsRel39.7 | 17 | |
| Depth Estimation | Realsee Real-World | AbsRel0.144 | 14 |