Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

NGD-SLAM: Towards Real-Time Dynamic SLAM without GPU

About

Many existing visual SLAM methods can achieve high localization accuracy in dynamic environments by leveraging deep learning to mask moving objects. However, these methods incur significant computational overhead as the camera tracking needs to wait for the deep neural network to generate mask at each frame, and they typically require GPUs for real-time operation, which restricts their practicality in real-world robotic applications. Therefore, this paper proposes a real-time dynamic SLAM system that runs exclusively on a CPU. Our approach incorporates a mask propagation mechanism that decouples camera tracking and deep learning-based masking for each frame. We also introduce a hybrid tracking strategy that integrates ORB features with optical flow methods, enhancing both robustness and efficiency by selectively allocating computational resources to input frames. Compared to previous methods, our system maintains high localization accuracy in dynamic environments while achieving a tracking frame rate of 60 FPS on a laptop CPU. These results demonstrate the feasibility of utilizing deep learning for dynamic SLAM without GPU support. Since most existing dynamic SLAM systems are not open-source, we make our code publicly available at: https://github.com/yuhaozhang7/NGD-SLAM

Yuhao Zhang, Mihai Bujanca, Mikel Luj\'an• 2024

Related benchmarks

TaskDatasetResultRank
SLAMTUM Highly Dynamic Sequences fr3 w rpy
ATE (m)0.034
7
SLAMTUM Highly Dynamic Sequences (fr3/w/half)
ATE (m)0.024
7
SLAMTUM Highly Dynamic Sequences (fr3/w/static)
ATE (m)0.007
7
SLAMTUM Highly Dynamic Sequences (fr3 w xyz)
ATE (m)0.015
7
SLAM Trajectory EstimationBONN mov no box
ATE RMSE (m)0.016
4
SLAM Trajectory EstimationBONN (crowd2)
ATE RMSE (m)0.025
4
SLAM Trajectory EstimationBONN person track
ATE RMSE (m)0.046
4
SLAM Trajectory EstimationBONN person track2
RMSE (ATE, m)0.062
4
SLAM Trajectory EstimationBONN (crowd3)
ATE RMSE (m)0.033
4
SLAM Trajectory EstimationBONN mov no box2
ATE RMSE (m)0.036
4
Showing 10 of 13 rows

Other info

Follow for update