Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Towards Zero-Shot Point Cloud Registration Across Diverse Scales, Scenes, and Sensor Setups

About

Some deep learning-based point cloud registration methods struggle with zero-shot generalization, often requiring dataset-specific hyperparameter tuning or retraining for new environments. We identify three critical limitations: (a) fixed user-defined parameters (e.g., voxel size, search radius) that fail to generalize across varying scales, (b) learned keypoint detectors exhibit poor cross-domain transferability, and (c) absolute coordinates amplify scale mismatches between datasets. To address these three issues, we present BUFFER-X, a training-free registration framework that achieves zero-shot generalization through: (a) geometric bootstrapping for automatic hyperparameter estimation, (b) distribution-aware farthest point sampling to replace learned detectors, and (c) patch-level coordinate normalization to ensure scale consistency. Our approach employs hierarchical multi-scale matching to extract correspondences across local, middle, and global receptive fields, enabling robust registration in diverse environments. For efficiency-critical applications, we introduce BUFFER-X-Lite, which reduces total computation time by 43% (relative to BUFFER-X) through early exit strategies and fast pose solvers while preserving accuracy. We evaluate on a comprehensive benchmark comprising 12 datasets spanning object-scale, indoor, and outdoor scenes, including cross-sensor registration between heterogeneous LiDAR configurations. Results demonstrate that our approach generalizes effectively without manual tuning or prior knowledge of test domains. Code: https://github.com/MIT-SPARK/BUFFER-X.

Hyungtae Lim, Minkyun Seo, Luca Carlone, Jaesik Park• 2026

Related benchmarks

TaskDatasetResultRank
Point cloud registration3DMatch
Registration Recall (RR)95
199
Point cloud registrationKITTI
RR99.82
106
Point cloud registration3DLoMatch
Registration Recall80.5
77
Point cloud registrationKAIST Aeva → Avia
Registration Success Rate98.24
34
Point cloud registrationTIERS OS128 → OS64
Registration Success Rate98.92
17
Point cloud registrationTIERS OS64 → Vel16
Registration Success Rate0.9946
17
Point cloud registrationTIERS Vel16 → OS128
Registration Success Rate84.32
17
Point cloud registrationKAIST Avia → Ouster
Registration Success Rate96.03
17
Showing 8 of 8 rows

Other info

Follow for update