Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LaRI: Layered Ray Intersections for Single-view 3D Geometric Reasoning

About

We present Layered Ray Intersections (LaRI), a fully supervised method for occluded geometry reasoning from a single image. Unlike conventional depth estimation, which is limited to visible surfaces, LaRI predicts multiple surfaces intersected by the camera rays using layered point maps. Compared to the existing approaches that leverage neural implicit representations or iterative refinement, LaRI achieves complete scene reconstruction in one feed-forward pass, enabling efficient and view-aligned geometric reasoning to underpin both object-level and scene-level tasks. We further propose to predict the ray stopping index, which identifies valid intersecting pixels and layers from LaRI's output. To better underpin and evaluate this task, we build an annotation pipeline using rendering engines, construct annotations for five public datasets, including synthetic and real-world data covering 3D objects and scenes. As a generic method, LaRI's performance is validated in object-level and scene-level reconstruction tasks.

Rui Li, Biao Zhang, Zhenyu Li, Federico Tombari, Peter Wonka• 2025

Related benchmarks

TaskDatasetResultRank
Depth EstimationNYU Depth V2
RMSE0.1424
226
Scene CompletionSCRREAM Complete
CD5.9
15
Object-level 3D ReconstructionGSO
CD0.025
11
3D ReconstructionSCRREAM Occluded
Chamfer Distance (CD)5.23
10
3D ReconstructionSCRREAM Complete
CD5.19
10
Scene CompletionSCRREAM Visible
CD0.057
10
3D ReconstructionSCRREAM Visible
CD3.43
10
3D ReconstructionNRGB-D (Occluded)
Chamfer Distance13.04
8
3D ReconstructionNRGB-D Visible
Chamfer Distance (CD)4.09
8
3D ReconstructionNRGB-D (Complete)
Chamfer Distance (CD)9.79
8
Showing 10 of 23 rows

Other info

Follow for update