Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

A Consistency-Aware Spot-Guided Transformer for Versatile and Hierarchical Point Cloud Registration

About

Deep learning-based feature matching has shown great superiority for point cloud registration in the absence of pose priors. Although coarse-to-fine matching approaches are prevalent, the coarse matching of existing methods is typically sparse and loose without consideration of geometric consistency, which makes the subsequent fine matching rely on ineffective optimal transport and hypothesis-and-selection methods for consistency. Therefore, these methods are neither efficient nor scalable for real-time applications such as odometry in robotics. To address these issues, we design a consistency-aware spot-guided Transformer (CAST), which incorporates a spot-guided cross-attention module to avoid interfering with irrelevant areas, and a consistency-aware self-attention module to enhance matching capabilities with geometrically consistent correspondences. Furthermore, a lightweight fine matching module for both sparse keypoints and dense features can estimate the transformation accurately. Extensive experiments on both outdoor LiDAR point cloud datasets and indoor RGBD point cloud datasets demonstrate that our method achieves state-of-the-art accuracy, efficiency, and robustness.

Renlang Huang, Yufan Tang, Jiming Chen, Liang Li• 2024

Related benchmarks

TaskDatasetResultRank
Point cloud registrationKITTI odometry (sequences 8-10)
Success Rate100
70
Point cloud registrationnuScenes
RRE (°)0.2
25
Point cloud registration3DMatch indoor RGBD (test)
Registration Recall (5k samples)95.2
16
Point cloud registration3DLoMatch indoor RGBD (test)
Recall (5k samples)75.1
16
Point cloud registration3DMatch indoor RGBD
Registration Recall96.48
9
Point cloud registration3DLoMatch indoor RGBD
Registration Recall76.13
9
Point cloud registrationETH generalization from KITTI (test)
RTE (cm)5.25
9
Showing 7 of 7 rows

Other info

Code

Follow for update