DG-SLAM: Robust Dynamic Gaussian Splatting SLAM with Hybrid Pose Optimization
About
Achieving robust and precise pose estimation in dynamic scenes is a significant research challenge in Visual Simultaneous Localization and Mapping (SLAM). Recent advancements integrating Gaussian Splatting into SLAM systems have proven effective in creating high-quality renderings using explicit 3D Gaussian models, significantly improving environmental reconstruction fidelity. However, these approaches depend on a static environment assumption and face challenges in dynamic environments due to inconsistent observations of geometry and photometry. To address this problem, we propose DG-SLAM, the first robust dynamic visual SLAM system grounded in 3D Gaussians, which provides precise camera pose estimation alongside high-fidelity reconstructions. Specifically, we propose effective strategies, including motion mask generation, adaptive Gaussian point management, and a hybrid camera tracking algorithm to improve the accuracy and robustness of pose estimation. Extensive experiments demonstrate that DG-SLAM delivers state-of-the-art performance in camera pose estimation, map reconstruction, and novel-view synthesis in dynamic scenes, outperforming existing methods meanwhile preserving real-time rendering ability.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Tracking | TUM 8 dynamic scenes | f3 Walk Scale/Translation Error0.6 | 28 | |
| Tracking | TUM RGB-D 44 (various sequences) | Average Error1.68 | 28 | |
| Camera Tracking | BONN dynamic sequences | Balloon Error3.7 | 25 | |
| Tracking | Bonn RGB-D dataset | Balloon24.1 | 23 | |
| Camera Tracking | TUM dynamic scene sequences RGB-D (test) | f3/w_s ATE (cm)0.6 | 17 | |
| Tracking | TUM-RGBD (various sequences) | Average Translational Error1.68 | 16 | |
| Camera Tracking | TUM dynamic scene sequences | ATE Component w_x (f3)1.6 | 15 | |
| Camera Tracking | ScanNet static sequences | ATE (Seq 00)7.9 | 11 | |
| Tracking | MoCap RGB-D | Ball Tracking Score0.8 | 11 | |
| Tracking Accuracy | BONN | bal1 Score3.7 | 8 |