Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PALoc: Advancing SLAM Benchmarking with Prior-Assisted 6-DoF Trajectory Generation and Uncertainty Estimation

About

Accurately generating ground truth (GT) trajectories is essential for Simultaneous Localization and Mapping (SLAM) evaluation, particularly under varying environmental conditions. This study introduces a systematic approach employing a prior map-assisted framework for generating dense six-degree-of-freedom (6-DoF) GT poses for the first time, enhancing the fidelity of both indoor and outdoor SLAM datasets. Our method excels in handling degenerate and stationary conditions frequently encountered in SLAM datasets, thereby increasing robustness and precision. A significant aspect of our approach is the detailed derivation of covariances within the factor graph, enabling an in-depth analysis of pose uncertainty propagation. This analysis crucially contributes to demonstrating specific pose uncertainties and enhancing trajectory reliability from both theoretical and empirical perspectives. Additionally, we provide an open-source toolbox (https://github.com/JokerJohn/Cloud_Map_Evaluation) for map evaluation criteria, facilitating the indirect assessment of overall trajectory precision. Experimental results show at least a 30\% improvement in map accuracy and a 20\% increase in direct trajectory accuracy compared to the Iterative Closest Point (ICP) \cite{sharp2002icp} algorithm across diverse campus environments, with substantially enhanced robustness. Our open-source solution (https://github.com/JokerJohn/PALoc), extensively applied in the FusionPortable\cite{Jiao2022Mar} dataset, is geared towards SLAM benchmark dataset augmentation and represents a significant advancement in SLAM evaluations.

Xiangcheng Hu, Linwei Zheng, Jin Wu, Ruoyu Geng, Yang Yu, Hexiang Wei, Xiaoyu Tang, Lujia Wang, Jianhao Jiao, Ming Liu• 2024

Related benchmarks

TaskDatasetResultRank
Trajectory EstimationM2DGR
ATE (m)0.177
50
Trajectory EstimationNTU-VIRAL
ATE (m)0.096
50
LiDAR-Inertial OdometryM2DGR Average
CR (%)71.112
10
LiDAR-Inertial OdometryM2DGR (gate.01)
CR (%)98.019
10
LiDAR OdometryLivox Mid-360 seq. 1
ATE (m)0.255
7
LiDAR-Inertial OdometryLivox Mid-360 seq. 2
CR100
7
LiDAR-Inertial OdometryLivox Mid-360 seq. 3
CR100
7
LiDAR OdometryLivox Mid-360 seq. 2
ATE (m)0.251
7
LiDAR OdometryLivox Mid-360 seq. 3
ATE (m)0.22
7
LiDAR-Inertial OdometryLivox Mid-360 seq. 1
CR Error (Seq 1)74.468
7
Showing 10 of 17 rows

Other info

Follow for update