Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

NICE-SLAM: Neural Implicit Scalable Encoding for SLAM

About

Neural implicit representations have recently shown encouraging results in various domains, including promising progress in simultaneous localization and mapping (SLAM). Nevertheless, existing methods produce over-smoothed scene reconstructions and have difficulty scaling up to large scenes. These limitations are mainly due to their simple fully-connected network architecture that does not incorporate local information in the observations. In this paper, we present NICE-SLAM, a dense SLAM system that incorporates multi-level local information by introducing a hierarchical scene representation. Optimizing this representation with pre-trained geometric priors enables detailed reconstruction on large indoor scenes. Compared to recent neural implicit SLAM systems, our approach is more scalable, efficient, and robust. Experiments on five challenging datasets demonstrate competitive results of NICE-SLAM in both mapping and tracking quality. Project page: https://pengsongyou.github.io/nice-slam

Zihan Zhu, Songyou Peng, Viktor Larsson, Weiwei Xu, Hujun Bao, Zhaopeng Cui, Martin R. Oswald, Marc Pollefeys• 2021

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisReplica
PSNR24.42
198
Camera pose estimationScanNet--
133
Photometric RenderingReplica (room0-2, office0-4)
PSNR30.34
80
3D Geometry ReconstructionScanNet
Accuracy3.2
54
Camera TrackingReplica
Rotation Error (rm-0)0.97
48
TrackingTUM RGB-D 44 (various sequences)
Average Error69.96
41
Camera TrackingBONN dynamic sequences
Balloon Error24.4
38
Absolute Trajectory EstimationTUM RGB-D
Desk Error0.027
36
Camera TrackingTUM RGB-D
Tracking Error (fr1/desk)2.7
36
TrackingScanNet
ATE RMSE (Seq 00)12
29
Showing 10 of 157 rows
...

Other info

Code

Follow for update