RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenes
About
3D Gaussian Splatting (3DGS) has become a popular solution in SLAM, as it can produce high-fidelity novel views. However, previous GS-based methods primarily target indoor scenes and rely on RGB-D sensors or pre-trained depth estimation models, hence underperforming in outdoor scenarios. To address this issue, we propose a RGB-only gaussian splatting SLAM method for unbounded outdoor scenes--OpenGS-SLAM. Technically, we first employ a pointmap regression network to generate consistent pointmaps between frames for pose estimation. Compared to commonly used depth maps, pointmaps include spatial relationships and scene geometry across multiple views, enabling robust camera pose estimation. Then, we propose integrating the estimated camera poses with 3DGS rendering as an end-to-end differentiable pipeline. Our method achieves simultaneous optimization of camera poses and 3DGS scene parameters, significantly enhancing system tracking accuracy. Specifically, we also design an adaptive scale mapper for the pointmap regression network, which provides more accurate pointmap mapping to the 3DGS map representation. Our experiments on the Waymo dataset demonstrate that OpenGS-SLAM reduces tracking error to 9.8\% of previous 3DGS methods, and achieves state-of-the-art results in novel view synthesis. Project Page: https://3dagentworld.github.io/opengs-slam/
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Novel View Synthesis | SeaThru-NeRF Panama | PSNR19.59 | 18 | |
| Novel View Synthesis | SeaThru-NeRF (J.G.-RedSea) | PSNR17.11 | 18 | |
| Novel View Synthesis | SeaThru-NeRF Avg | PSNR18.35 | 7 | |
| Novel View Synthesis | WaterSplat-SLAM Average | PSNR23.89 | 7 | |
| Novel View Synthesis | WaterSplat-SLAM Pool_up2 | PSNR24.76 | 7 | |
| Camera Tracking | WaterSplat-SLAM Pool_up2 | ATE (m)2.249 | 7 | |
| Camera Tracking | WaterSplat-SLAM Pool_up | ATE (m)2.063 | 6 | |
| Novel View Synthesis | WaterSplat-SLAM Pool_up | PSNR23.01 | 6 | |
| Novel View Rendering | Waymo Open Dataset (Segment 100613) | PSNR24.41 | 5 | |
| Novel View Rendering | Waymo Open Dataset (Segment 13476) | PSNR22.29 | 5 |