Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DST-Calib: A Dual-Path, Self-Supervised, Target-Free LiDAR-Camera Extrinsic Calibration Network

About

LiDAR-camera extrinsic calibration is essential for multi-modal data fusion in robotic perception systems. However, existing approaches typically rely on handcrafted calibration targets (e.g., checkerboards) or specific, static scene types, limiting their adaptability and deployment in real-world autonomous and robotic applications. This article presents the first self-supervised LiDAR-camera extrinsic calibration network that operates in an online fashion and eliminates the need for specific calibration targets. We first identify a significant generalization degradation problem in prior methods, caused by the conventional single-sided data augmentation strategy. To overcome this limitation, we propose a novel double-sided data augmentation technique that generates multi-perspective camera views using estimated depth maps, thereby enhancing robustness and diversity during training. Built upon this augmentation strategy, we design a dual-path, self-supervised calibration framework that reduces the dependence on high-precision ground truth labels and supports fully adaptive online calibration. Furthermore, to improve cross-modal feature association, we replace the traditional dual-branch feature extraction design with a difference map construction process that explicitly correlates LiDAR and camera features. This not only enhances calibration accuracy but also reduces model complexity. Extensive experiments conducted on five public benchmark datasets, as well as our own recorded dataset, demonstrate that the proposed method significantly outperforms existing approaches in terms of generalizability.

Zhiwei Huang, Yanwei Fu, Yi Zhou, Xieyuanli Chen, Qijun Chen, Rui Fan• 2026

Related benchmarks

TaskDatasetResultRank
LiDAR-Camera Extrinsic CalibrationKITTI Odometry Sequence 06
Rotational Error (er)0.305
23
LiDAR-Camera Extrinsic CalibrationKITTI Odometry Sequence 09
Error Rotation (er)0.273
23
LiDAR-Camera Extrinsic CalibrationKITTI Odometry Sequence 01
Error (Rotation)0.435
23
LiDAR-Camera Extrinsic CalibrationKITTI Odometry Sequence 02
Rotation Error0.297
23
LiDAR-Camera Extrinsic CalibrationKITTI Odometry Sequence 03
Error Rate (er)0.439
23
LiDAR-Camera Extrinsic CalibrationKITTI Odometry Sequence 04
Rotation Error0.382
23
LiDAR-Camera Extrinsic CalibrationKITTI Odometry Sequence 05
Rotation Error (er)0.318
23
LiDAR-Camera Extrinsic CalibrationKITTI Odometry Sequence 07
Rotational Error0.285
23
LiDAR-to-Camera CalibrationKITTI Odometry Left Camera Sequence 00--
12
LiDAR-to-Camera CalibrationKITTI Odometry Right Camera Sequence 00--
12
Showing 10 of 18 rows

Other info

Follow for update