AirSLAM: An Efficient and Illumination-Robust Point-Line Visual SLAM System
About
In this paper, we present an efficient visual SLAM system designed to tackle both short-term and long-term illumination challenges. Our system adopts a hybrid approach that combines deep learning techniques for feature detection and matching with traditional backend optimization methods. Specifically, we propose a unified convolutional neural network (CNN) that simultaneously extracts keypoints and structural lines. These features are then associated, matched, triangulated, and optimized in a coupled manner. Additionally, we introduce a lightweight relocalization pipeline that reuses the built map, where keypoints, lines, and a structure graph are used to match the query frame with the map. To enhance the applicability of the proposed system to real-world robots, we deploy and accelerate the feature detection and matching networks using C++ and NVIDIA TensorRT. Extensive experiments conducted on various datasets demonstrate that our system outperforms other state-of-the-art visual SLAM systems in illumination-challenging environments. Efficiency evaluations show that our system can run at a rate of 73Hz on a PC and 40Hz on an embedded platform. Our implementation is open-sourced: https://github.com/sair-lab/AirSLAM.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Visual-Inertial Odometry | EuRoC (All sequences) | -- | 62 | |
| Wireframe Parsing | YorkUrban | sAP529.3 | 11 | |
| Wireframe Parsing | Wireframe | AP (5)65.2 | 11 | |
| Visual-Inertial Odometry | EuRoC MAV MH01 Easy | ATE RMSE7.4 | 8 | |
| Visual-Inertial Odometry | EuRoC MAV Medium (MH03) | ATE RMSE (cm)11.4 | 8 | |
| Visual-Inertial Odometry | EuRoC MAV V101 Easy | ATE RMSE (cm)3.3 | 8 | |
| Visual-Inertial Odometry | EuRoC MAV Easy (MH02) | ATE RMSE (cm)6 | 8 | |
| Visual-Inertial Odometry | EuRoC MAV MH05 (Hard) | ATE RMSE (cm)12.5 | 8 | |
| Visual-Inertial Odometry | EuRoC MAV Easy V201 | ATE RMSE (cm)3.6 | 8 | |
| Visual-Inertial Odometry | EuRoC MAV Medium V202 | ATE RMSE (cm)8.3 | 8 |