Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

TRIG: Trajectory-Rig Decoupled Metric Geometry Learning

About

Vision-centric autonomous driving requires accurate metric geometry and ego-motion estimation from synchronized multi-camera observations. Recent visual geometry models show strong performance in pose estimation, depth prediction, and 3D reconstruction, but are not tailored to rigid multi-camera driving systems. They often encode camera poses as entangled representations, in which time-varying ego-motion and static camera-rig geometry are jointly modeled, limiting the utilization of vehicle-side geometric priors. We propose Trajectory-Rig Decoupled Metric Geometry Learning (TRIG), a geometry perception framework for autonomous driving. TRIG factorizes camera poses into ego-trajectory and camera-rig components, enabling separate modeling of ego-motion and static multi-camera topology. We introduce decoupled pose encoding and supervision, which separately constrain trajectory evolution and rig geometry for metric-consistent learning. Moreover, sparse Temporal--Spatial attention separates cross-camera interaction from temporal aggregation, reducing global attention cost while preserving geometric reasoning. Experiments on five autonomous driving benchmarks show that TRIG achieves state-of-the-art performance in pose estimation, metric depth prediction, and 3D reconstruction.

Lizhou Liao, Wentao Xu, Handong Wang, Lirong Yang, Shuai Yang, Weiwei Liu, Chang Huang• 2026

Related benchmarks

TaskDatasetResultRank
Depth EstimationKITTI--
184
3D ReconstructionDDAD
Accuracy0.587
36
3D ReconstructionnuScenes
Acc0.314
29
Depth EstimationDDAD--
26
3D ReconstructionOpenScene
Accuracy0.38
22
3D ReconstructionWaymo
Accuracy0.509
21
Single-view metric depth estimationOpenScene
Absolute Relative Error (Abs Rel)0.041
20
Single-view metric depth estimationWaymo
Abs Rel0.094
20
3D ReconstructionKITTI
Acc Mean0.333
17
Camera pose estimationnuScenes
AUC@3096.6
16
Showing 10 of 15 rows

Other info

Follow for update