DegBins: Degradation-Driven Binning for Depth Super-Resolution
About
Depth super-resolution (DSR) aims to recover a high-resolution (HR) depth map from its low-resolution (LR) counterpart. With color image guidance, this task is typically formulated as learning the residual between HR and LR in a low-dimensional feature space. However, this additive formulation is insufficient to accurately capture the complex relationship between HR and LR, especially under spatially varying degradations. In this paper, we introduce DegBins, a novel DSR framework that leverages degradation-driven binning to adaptively enhance residual modeling. Specifically, DegBins reformulates the regression-based DSR as a hybrid classification-regression problem, where the residual depth is represented as a linear combination of discrete depth bins weighted by their learned probability distribution, yielding more flexible and expressive representations. Furthermore, DegBins models the degradation relationship between HR and LR in a high-dimensional feature space, enabling adaptive bin range adjustment and probability optimization conditioned on local degradation characteristics. To progressively improve reconstruction quality, DegBins adopts a multi-stage refinement scheme, where each stage performs finer-grained bin partitioning and probability updating based on the former estimation. This coarse-to-fine design facilitates more accurate depth recovery, particularly in regions with severe degradations or complex structural variations. Extensive experiments across five benchmarks demonstrate that DegBins consistently outperforms existing state-of-the-art methods in terms of accuracy, robustness, and generalization.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Depth Super-Resolution | NYU v2 (test) | RMSE1.12 | 190 | |
| Depth Super-Resolution | Middlebury (test) | RMSE0.76 | 64 | |
| Depth Super-Resolution | Lu (test) | RMSE0.57 | 64 | |
| Depth Super-Resolution | RGB-D-D (test) | RMSE0.68 | 54 | |
| Depth Super-Resolution | TOFDSR (test) | RMSE0.46 | 54 | |
| Depth Super-Resolution | RGB-D-D | RMSE3.52 | 40 | |
| Depth Super-Resolution | TOFDSR | RMSE4.06 | 40 | |
| Compressed Depth Super-Resolution | NYU V2 | RMSE51.26 | 10 | |
| Compressed Depth Super-Resolution | RGB-D-D | RMSE19.74 | 10 | |
| Compressed Depth Super-Resolution | TOFDSR | RMSE27.35 | 10 |