Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Amodal3R: Amodal 3D Reconstruction from Occluded 2D Images

About

Most image-based 3D object reconstructors assume that objects are fully visible, ignoring occlusions that commonly occur in real-world scenarios. In this paper, we introduce Amodal3R, a conditional 3D generative model designed to reconstruct 3D objects from partial observations. We start from a "foundation" 3D generative model and extend it to recover plausible 3D geometry and appearance from occluded objects. We introduce a mask-weighted multi-head cross-attention mechanism followed by an occlusion-aware attention layer that explicitly leverages occlusion priors to guide the reconstruction process. We demonstrate that, by training solely on synthetic data, Amodal3R learns to recover full 3D objects even in the presence of occlusions in real scenes. It substantially outperforms existing methods that independently perform 2D amodal completion followed by 3D reconstruction, thereby establishing a new benchmark for occlusion-aware 3D reconstruction.

Tianhao Wu, Chuanxia Zheng, Frank Guan, Andrea Vedaldi, Tat-Jen Cham• 2025

Related benchmarks

TaskDatasetResultRank
3D ReconstructionGSO
RGB-LPIPS Mean0.1532
11
Image-to-3D ReconstructionShapeR evaluation
ShapeR Win Rate86.11
4
Object Generation3D-Front rendered by InstPifu (test)
Chamfer Distance0.0443
3
Showing 3 of 3 rows

Other info

Follow for update