Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

HI-SLAM2: Geometry-Aware Gaussian SLAM for Fast Monocular Scene Reconstruction

About

We present HI-SLAM2, a geometry-aware Gaussian SLAM system that achieves fast and accurate monocular scene reconstruction using only RGB input. Existing Neural SLAM or 3DGS-based SLAM methods often trade off between rendering quality and geometry accuracy, our research demonstrates that both can be achieved simultaneously with RGB input alone. The key idea of our approach is to enhance the ability for geometry estimation by combining easy-to-obtain monocular priors with learning-based dense SLAM, and then using 3D Gaussian splatting as our core map representation to efficiently model the scene. Upon loop closure, our method ensures on-the-fly global consistency through efficient pose graph bundle adjustment and instant map updates by explicitly deforming the 3D Gaussian units based on anchored keyframe updates. Furthermore, we introduce a grid-based scale alignment strategy to maintain improved scale consistency in prior depths for finer depth details. Through extensive experiments on Replica, ScanNet, and ScanNet++, we demonstrate significant improvements over existing Neural SLAM methods and even surpass RGB-D-based methods in both reconstruction and rendering quality. The project page and source code will be made available at https://hi-slam2.github.io/.

Wei Zhang, Qing Cheng, David Skuddis, Niclas Zeller, Daniel Cremers, Norbert Haala• 2024

Related benchmarks

TaskDatasetResultRank
TrackingStrided EuRoC
MH 01 Sequence Result1.58
48
TrackingRPNG AR Table Dataset Stride 1
Table 01 Performance Summary100
15
TrackingRPNG AR Table Dataset Stride 5
Tracking Performance (Table 01)98.63
15
TrackingRPNG AR Table Dataset Stride 10
Tracking Success Rate (Table 02)76.9
15
TrackingRPNG AR Table Dataset Stride 20
Table 07 Performance Score100
14
TrackingEuRoC Dataset
MH 01 Score2.66
13
TrackingRPNG AR Table Dataset Stride 40
ATE RMSE (Table 01)0.00e+0
12
Appearance RenderingFAST-LIVO2
PSNR21.49
11
TrackingUTMM
Ego-12.06
9
TrackingRPNG AR Table Dataset
Table 01 Tracking Error1.43
8
Showing 10 of 13 rows

Other info

Follow for update