Complet4R: Geometric Complete 4D Reconstruction
About
We introduce Complet4R, a novel end-to-end framework for Geometric Complete 4D Reconstruction, which aims to recover temporally coherent and geometrically complete reconstruction for dynamic scenes. Our method formalizes the task of Geometric Complete 4D Reconstruction as a unified framework of reconstruction and completion, by directly accumulating full contexts onto each frame. Unlike previous approaches that rely on pairwise reconstruction or local motion estimation, Complet4R utilizes a decoder-only transformer to operate all context globally directly from sequential video input, reconstructing a complete geometry for every single timestamp, including occluded regions visible in other frames. Our method demonstrates the state-of-the-art performance on our proposed benchmark for Geometric Complete 4D Reconstruction and the 3D Point Tracking task. Code will be released to support future research.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Video Depth Estimation | Sintel | Delta Threshold Accuracy (1.25)63.9 | 193 | |
| Camera pose estimation | Sintel | ATE0.215 | 192 | |
| Video Depth Estimation | KITTI | Abs Rel0.079 | 126 | |
| Camera pose estimation | ScanNet | RPE (t)0.023 | 119 | |
| Video Depth Estimation | BONN | AbsRel6.6 | 116 | |
| World Coordinate 3D Point Tracking | Panoptic Studio | APD85.62 | 10 | |
| World Coordinate 3D Point Tracking on Dynamic Points | PStudio (Panoptic Studio) | APD76.88 | 6 | |
| World Coordinate 3D Point Tracking | ADT | APD87.58 | 6 | |
| World Coordinate 3D Point Tracking | PO | Average Point Distance (APD)85.82 | 6 | |
| World Coordinate 3D Point Tracking | DR | APD85.3 | 6 |