LoopSplat: Loop Closure by Registering 3D Gaussian Splats
About
Simultaneous Localization and Mapping (SLAM) based on 3D Gaussian Splats (3DGS) has recently shown promise towards more accurate, dense 3D scene maps. However, existing 3DGS-based methods fail to address the global consistency of the scene via loop closure and/or global bundle adjustment. To this end, we propose LoopSplat, which takes RGB-D images as input and performs dense mapping with 3DGS submaps and frame-to-model tracking. LoopSplat triggers loop closure online and computes relative loop edge constraints between submaps directly via 3DGS registration, leading to improvements in efficiency and accuracy over traditional global-to-local point cloud registration. It uses a robust pose graph optimization formulation and rigidly aligns the submaps to achieve global consistency. Evaluation on the synthetic Replica and real-world TUM-RGBD, ScanNet, and ScanNet++ datasets demonstrates competitive or superior tracking, mapping, and rendering compared to existing methods for dense RGB-D SLAM. Code is available at loopsplat.github.io.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Novel View Synthesis | ScanNet++ | -- | 67 | |
| Camera Tracking | Replica | Rotation Error (rm-0)0.28 | 38 | |
| Mesh Reconstruction | Replica Room 0 | Depth L1 Error0.32 | 21 | |
| Tracking | ScanNet | ATE RMSE (Seq 00)6.2 | 18 | |
| Tracking | ScanNet++ | Metric c3.16 | 9 | |
| Novel View Synthesis | ScanNet 5 (test) | PSNR24.92 | 8 | |
| Mesh Reconstruction | Replica R1 (Room 1) | Depth L1 Error0.23 | 8 | |
| Mesh Reconstruction | Replica Office 1 | Depth L1 Error0.51 | 8 | |
| Mesh Reconstruction | Replica Office 4 | Depth L10.4 | 8 | |
| Novel View Synthesis | Replica 36 (test) | PSNR36.63 | 8 |