Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LoopSplat: Loop Closure by Registering 3D Gaussian Splats

About

Simultaneous Localization and Mapping (SLAM) based on 3D Gaussian Splats (3DGS) has recently shown promise towards more accurate, dense 3D scene maps. However, existing 3DGS-based methods fail to address the global consistency of the scene via loop closure and/or global bundle adjustment. To this end, we propose LoopSplat, which takes RGB-D images as input and performs dense mapping with 3DGS submaps and frame-to-model tracking. LoopSplat triggers loop closure online and computes relative loop edge constraints between submaps directly via 3DGS registration, leading to improvements in efficiency and accuracy over traditional global-to-local point cloud registration. It uses a robust pose graph optimization formulation and rigidly aligns the submaps to achieve global consistency. Evaluation on the synthetic Replica and real-world TUM-RGBD, ScanNet, and ScanNet++ datasets demonstrates competitive or superior tracking, mapping, and rendering compared to existing methods for dense RGB-D SLAM. Code is available at loopsplat.github.io.

Liyuan Zhu, Yue Li, Erik Sandstr\"om, Shengyu Huang, Konrad Schindler, Iro Armeni• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisScanNet++--
67
Camera TrackingReplica
Rotation Error (rm-0)0.28
38
Mesh ReconstructionReplica Room 0
Depth L1 Error0.32
21
TrackingScanNet
ATE RMSE (Seq 00)6.2
18
TrackingScanNet++
Metric c3.16
9
Novel View SynthesisScanNet 5 (test)
PSNR24.92
8
Mesh ReconstructionReplica R1 (Room 1)
Depth L1 Error0.23
8
Mesh ReconstructionReplica Office 1
Depth L1 Error0.51
8
Mesh ReconstructionReplica Office 4
Depth L10.4
8
Novel View SynthesisReplica 36 (test)
PSNR36.63
8
Showing 10 of 15 rows

Other info

Follow for update