Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GLASS: Geometry-aware Local Alignment and Structure Synchronization Network for 2D-3D Registration

About

Image-to-point cloud registration methods typically follow a coarse-to-fine pipeline, extracting patch-level correspondences and refining them into dense pixel-to-point matches. However, in scenes with repetitive patterns, images often lack sufficient 3D structural cues and alignment with point clouds, leading to incorrect matches. Moreover, prior methods usually overlook structural consistency, limiting the full exploitation of correspondences. To address these issues, we propose two novel modules: the Local Geometry Enhancement (LGE) module and the Graph Distribution Consistency (GDC) module. LGE enhances both image and point cloud features with normal vectors, injecting geometric structure into image features to reduce mismatches. GDC constructs a graph from matched points to update features and explicitly constrain similarity distributions. Extensive experiments and ablations on two benchmarks, RGB-D Scenes v2 and 7-Scenes, demonstrate that our approach achieves state-of-the-art performance in image-to-point cloud registration.

Zhixin Cheng, Jiacheng Deng, Xinjun Li, Bohao Liao, Li Liu, Xiaotian Yin, Baoqun Yin, Tianzhu Zhang• 2026

Related benchmarks

TaskDatasetResultRank
2D/3D RegistrationRGB-D Scenes v2
Inlier Ratio54.3
45
Geometric RegistrationKITTI
RTE1.54
34
2D/3D Registration7 Scenes
Inlier Ratio (Chs)73.9
8
3D Point Cloud RegistrationRGB-D Scenes v2
Mean Rotation Error (RRE) (°)1.976
4
3D Point Cloud Registration7 Scenes
Mean Rotation Error (RRE)2.735
4
Showing 5 of 5 rows

Other info

Follow for update