Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priors

About

We present a real-time monocular dense SLAM system designed bottom-up from MASt3R, a two-view 3D reconstruction and matching prior. Equipped with this strong prior, our system is robust on in-the-wild video sequences despite making no assumption on a fixed or parametric camera model beyond a unique camera centre. We introduce efficient methods for pointmap matching, camera tracking and local fusion, graph construction and loop closure, and second-order global optimisation. With known calibration, a simple modification to the system achieves state-of-the-art performance across various benchmarks. Altogether, we propose a plug-and-play monocular SLAM system capable of producing globally-consistent poses and dense geometry while operating at 15 FPS.

Riku Murai, Eric Dexheimer, Andrew J. Davison• 2024

Related benchmarks

TaskDatasetResultRank
Camera pose estimationTUM-dynamic
ATE0.038
205
Camera pose estimationScanNet
RPE (t)0.02
133
3D Reconstruction7 Scenes--
128
3D ReconstructionNRGBD--
66
Visual-Inertial OdometryEuRoC (All sequences)
MH1 Error0.023
62
Camera pose estimationTUM
ATE1.21
59
3D Geometry Estimation and ReconstructionSpatialBench Single Frame
AbsRel0.348
42
3D Geometry Estimation and ReconstructionSpatialBench Sparse
AbsRel0.336
42
3D Geometry Estimation and ReconstructionSpatialBench Medium
AbsRel0.348
42
3D Geometry Estimation and ReconstructionSpatialBench Average across settings
Absolute Relative Error35.9
42
Showing 10 of 100 rows
...

Other info

Follow for update