Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

BEVPlace++: Fast, Robust, and Lightweight LiDAR Global Localization for Unmanned Ground Vehicles

About

This article introduces BEVPlace++, a novel, fast, and robust LiDAR global localization method for unmanned ground vehicles. It uses lightweight convolutional neural networks (CNNs) on Bird's Eye View (BEV) image-like representations of LiDAR data to achieve accurate global localization through place recognition, followed by 3-DoF pose estimation. Our detailed analyses reveal an interesting fact that CNNs are inherently effective at extracting distinctive features from LiDAR BEV images. Remarkably, keypoints of two BEV images with large translations can be effectively matched using CNN-extracted features. Building on this insight, we design a Rotation Equivariant Module (REM) to obtain distinctive features while enhancing robustness to rotational changes. A Rotation Equivariant and Invariant Network (REIN) is then developed by cascading REM and a descriptor generator, NetVLAD, to sequentially generate rotation equivariant local features and rotation invariant global descriptors. The global descriptors are used first to achieve robust place recognition, and then local features are used for accurate pose estimation. \revise{Experimental results on seven public datasets and our UGV platform demonstrate that BEVPlace++, even when trained on a small dataset (3000 frames of KITTI) only with place labels, generalizes well to unseen environments, performs consistently across different days and years, and adapts to various types of LiDAR scanners.} BEVPlace++ achieves state-of-the-art performance in multiple tasks, including place recognition, loop closure detection, and global localization. Additionally, BEVPlace++ is lightweight, runs in real-time, and does not require accurate pose supervision, making it highly convenient for deployment. \revise{The source codes are publicly available at https://github.com/zjuluolun/BEVPlace2.

Lun Luo, Si-Yuan Cao, Xiaorui Li, Jintao Xu, Rui Ai, Zhu Yu, Xieyuanli Chen• 2024

Related benchmarks

TaskDatasetResultRank
Place RecognitionnuScenes (BS)
AR@192.53
18
Place RecognitionnuScenes (SON)
AR@193.95
17
Place RecognitionNCLT (Query: 2012-06-15, Database: 2012-01-08)
AR@187.64
16
Place RecognitionNCLT (Query: 2013-02-23, Database: 2012-01-08)
AR@10.8773
16
Place RecognitionnuScenes Simulated Fog (SQ)
AR@195.06
16
Place RecognitionSelf-collected dataset
AR@172.6
11
Place RecognitionNCLT (Query: 2012-09-28, Database: 2012-01-08)
AR@189.54
7
Place RecognitionOxford Radar v1.0 (Query: 2019-01-18-14-46-59, Database: 2019-01-10-14-50-05)
AR@199.18
7
Place RecognitionBoreas Query: 2021-09-14-20-00, Database: 2020-12-18-13-44
AR@175.46
7
Place RecognitionBoreas Query: 2021-11-16-14-10, Database: 2020-12-18-13-44
AR@10.8393
7
Showing 10 of 28 rows

Other info

Follow for update