Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DDN-SLAM: Real-time Dense Dynamic Neural Implicit SLAM

About

SLAM systems based on NeRF have demonstrated superior performance in rendering quality and scene reconstruction for static environments compared to traditional dense SLAM. However, they encounter tracking drift and mapping errors in real-world scenarios with dynamic interferences. To address these issues, we introduce DDN-SLAM, the first real-time dense dynamic neural implicit SLAM system integrating semantic features. To address dynamic tracking interferences, we propose a feature point segmentation method that combines semantic features with a mixed Gaussian distribution model. To avoid incorrect background removal, we propose a mapping strategy based on sparse point cloud sampling and background restoration. We propose a dynamic semantic loss to eliminate dynamic occlusions. Experimental results demonstrate that DDN-SLAM is capable of robustly tracking and producing high-quality reconstructions in dynamic environments, while appropriately preserving potential dynamic objects. Compared to existing neural implicit SLAM systems, the tracking results on dynamic datasets indicate an average 90% improvement in Average Trajectory Error (ATE) accuracy.

Mingrui Li, Yiming Zhou, Guangan Jiang, Tianchen Deng, Yangyang Wang, Hongyu Wang• 2024

Related benchmarks

TaskDatasetResultRank
TrackingTUM 8 dynamic scenes
f3 Walk Scale/Translation Error1
28
TrackingTUM RGB-D 44 (various sequences)--
28
Camera TrackingBONN dynamic sequences
Balloon Error1.8
25
Camera TrackingTUM dynamic scene sequences RGB-D (test)
f3/w_s ATE (cm)1
17
Showing 4 of 4 rows

Other info

Follow for update