TRIG: Trajectory-Rig Decoupled Metric Geometry Learning
About
Vision-centric autonomous driving requires accurate metric geometry and ego-motion estimation from synchronized multi-camera observations. Recent visual geometry models show strong performance in pose estimation, depth prediction, and 3D reconstruction, but are not tailored to rigid multi-camera driving systems. They often encode camera poses as entangled representations, in which time-varying ego-motion and static camera-rig geometry are jointly modeled, limiting the utilization of vehicle-side geometric priors. We propose Trajectory-Rig Decoupled Metric Geometry Learning (TRIG), a geometry perception framework for autonomous driving. TRIG factorizes camera poses into ego-trajectory and camera-rig components, enabling separate modeling of ego-motion and static multi-camera topology. We introduce decoupled pose encoding and supervision, which separately constrain trajectory evolution and rig geometry for metric-consistent learning. Moreover, sparse Temporal--Spatial attention separates cross-camera interaction from temporal aggregation, reducing global attention cost while preserving geometric reasoning. Experiments on five autonomous driving benchmarks show that TRIG achieves state-of-the-art performance in pose estimation, metric depth prediction, and 3D reconstruction.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Depth Estimation | KITTI | -- | 184 | |
| 3D Reconstruction | DDAD | Accuracy0.587 | 36 | |
| 3D Reconstruction | nuScenes | Acc0.314 | 29 | |
| Depth Estimation | DDAD | -- | 26 | |
| 3D Reconstruction | OpenScene | Accuracy0.38 | 22 | |
| 3D Reconstruction | Waymo | Accuracy0.509 | 21 | |
| Single-view metric depth estimation | OpenScene | Absolute Relative Error (Abs Rel)0.041 | 20 | |
| Single-view metric depth estimation | Waymo | Abs Rel0.094 | 20 | |
| 3D Reconstruction | KITTI | Acc Mean0.333 | 17 | |
| Camera pose estimation | nuScenes | AUC@3096.6 | 16 |