CP-SLAM: Collaborative Neural Point-based SLAM System
About
This paper presents a collaborative implicit neural simultaneous localization and mapping (SLAM) system with RGB-D image sequences, which consists of complete front-end and back-end modules including odometry, loop detection, sub-map fusion, and global refinement. In order to enable all these modules in a unified framework, we propose a novel neural point based 3D scene representation in which each point maintains a learnable neural feature for scene encoding and is associated with a certain keyframe. Moreover, a distributed-to-centralized learning strategy is proposed for the collaborative implicit SLAM to improve consistency and cooperation. A novel global optimization framework is also proposed to improve the system accuracy like traditional bundle adjustment. Experiments on various datasets demonstrate the superiority of the proposed method in both camera tracking and mapping.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Tracking | AriaMultiagent | ATE RMSE0.68 | 30 | |
| Trajectory tracking | Multi-agent Replica Apartment-1 | ATE RMSE (cm)1.11 | 15 | |
| Trajectory tracking | Multi-agent Replica Office-0-C | ATE RMSE (cm)0.5 | 15 | |
| SLAM Tracking | ReplicaMultiagent | Off-0 Score0.79 | 15 | |
| Trajectory tracking | Multi-agent Replica Apartment-2 | ATE RMSE (cm)1.41 | 15 | |
| Trajectory tracking | Multi-agent Replica Apartment-0 | ATE RMSE (cm)0.62 | 12 | |
| Trajectory tracking | Multi-agent Replica Average | ATE RMSE (cm)0.91 | 12 | |
| Multi-agent dense mapping | Multi-agent Replica Apartment-0 Synthetic | PSNR32.39 | 6 | |
| Multi-agent dense mapping | Multi-agent Replica Apartment-1 Synthetic | PSNR27.87 | 6 | |
| Multi-agent dense mapping | Multi-agent Replica Synthetic (Apartment-2) | PSNR25.9 | 6 |