Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

MAVIS: Multi-Camera Augmented Visual-Inertial SLAM using SE2(3) Based Exact IMU Pre-integration

About

We present a novel optimization-based Visual-Inertial SLAM system designed for multiple partially overlapped camera systems, named MAVIS. Our framework fully exploits the benefits of wide field-of-view from multi-camera systems, and the metric scale measurements provided by an inertial measurement unit (IMU). We introduce an improved IMU pre-integration formulation based on the exponential function of an automorphism of SE_2(3), which can effectively enhance tracking performance under fast rotational motion and extended integration time. Furthermore, we extend conventional front-end tracking and back-end optimization module designed for monocular or stereo setup towards multi-camera systems, and introduce implementation details that contribute to the performance of our system in challenging scenarios. The practical validity of our approach is supported by our experiments on public datasets. Our MAVIS won the first place in all the vision-IMU tracks (single and multi-session SLAM) on Hilti SLAM Challenge 2023 with 1.7 times the score compared to the second place.

Yifu Wang, Yonhon Ng, Inkyu Sa, Alvaro Parra, Cristian Rodriguez, Tao Jun Lin, Hongdong Li• 2023

Related benchmarks

TaskDatasetResultRank
Monocular Visual-Inertial OdometryTUM-VI
Avg RMSE ATE (m)0.0769
21
SLAMHilti 2022
Construction Ground Error0.094
20
Visual-Inertial OdometryEuRoC MAV
Average Error0.0475
19
SLAMNewer College
Quad Easy Error0.084
10
SLAMHilti 2023
Error (Floor 0)0.06
10
LocalizationHilti Benchmark (various sequences)
Performance (Exp04)0.083
8
Visual-Inertial OdometryHilti 2022
e04 Error0.0728
5
Showing 7 of 7 rows

Other info

Follow for update