GeoNLF: Geometry guided Pose-Free Neural LiDAR Fields
About
Although recent efforts have extended Neural Radiance Fields (NeRF) into LiDAR point cloud synthesis, the majority of existing works exhibit a strong dependence on precomputed poses. However, point cloud registration methods struggle to achieve precise global pose estimation, whereas previous pose-free NeRFs overlook geometric consistency in global reconstruction. In light of this, we explore the geometric insights of point clouds, which provide explicit registration priors for reconstruction. Based on this, we propose Geometry guided Neural LiDAR Fields(GeoNLF), a hybrid framework performing alternately global neural reconstruction and pure geometric pose optimization. Furthermore, NeRFs tend to overfit individual frames and easily get stuck in local minima under sparse-view inputs. To tackle this issue, we develop a selective-reweighting strategy and introduce geometric constraints for robust optimization. Extensive experiments on NuScenes and KITTI-360 datasets demonstrate the superiority of GeoNLF in both novel view synthesis and multi-view registration of low-frequency large-scale point clouds.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Pose Estimation | KITTI-360 | RPE Translation (cm)5.449 | 29 | |
| Pose Estimation | nuScenes | Translation Error (cm)7.058 | 17 | |
| Novel View Synthesis | nuScenes low-frequency setting | RMSE0.0378 | 16 | |
| LiDAR Novel View Synthesis (Depth) | KITTI-360 low-frequency setting (test) | RMSE4.0293 | 8 | |
| Point Cloud Reconstruction | nuScenes low-frequency setting | Chamfer Distance (CD)0.2408 | 8 | |
| Point Cloud Reconstruction | KITTI-360 low-frequency setting (test) | Chamfer Distance (CD)0.2363 | 8 | |
| LiDAR Novel View Synthesis (Intensity) | KITTI-360 low-frequency setting (test) | RMSE0.1495 | 8 | |
| LiDAR Depth Synthesis | KITTI-360 (standard-frequency setting) | RMSE2.7144 | 7 | |
| LiDAR Intensity Synthesis | KITTI-360 (standard-frequency setting) | RMSE0.1484 | 7 | |
| Point Cloud Reconstruction | KITTI-360 (standard-frequency setting) | CD0.1855 | 7 |