Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequences

About

Foundation models for 3D vision have recently demonstrated remarkable capabilities in 3D perception. However, extending these models to large-scale RGB stream 3D reconstruction remains challenging due to memory limitations. In this work, we propose VGGT-Long, a simple yet effective system that pushes the limits of monocular 3D reconstruction to kilometer-scale, unbounded outdoor environments. Our approach addresses the scalability bottlenecks of existing models through a chunk-based processing strategy combined with overlapping alignment and lightweight loop closure optimization. Without requiring camera calibration, depth supervision or model retraining, VGGT-Long achieves trajectory and reconstruction performance comparable to traditional methods. We evaluate our method on KITTI, Waymo, and Virtual KITTI datasets. VGGT-Long not only runs successfully on long RGB sequences where foundation models typically fail, but also produces accurate and consistent geometry across various conditions. Our results highlight the potential of leveraging foundation models for scalable monocular 3D scene in real-world settings, especially for autonomous driving scenarios. Code is available at https://github.com/DengKaiCQ/VGGT-Long.

Kai Deng, Zexin Ti, Jiawei Xu, Jian Yang, Jin Xie• 2025

Related benchmarks

TaskDatasetResultRank
3D Reconstruction7 Scenes--
128
Point Map Estimation7 Scenes
Accuracy (Mean)1.6
69
Visual-Inertial OdometryEuRoC (All sequences)
MH1 Error0.579
62
Visual OdometryKITTI
KITTI Seq 03 Error6.12
45
Visual OdometryTUM-RGBD
freiburg1/desk2 Error0.155
43
3D Geometry Estimation and ReconstructionSpatialBench Single Frame
AbsRel0.184
42
3D Geometry Estimation and ReconstructionSpatialBench Sparse
AbsRel0.092
42
3D Geometry Estimation and ReconstructionSpatialBench Average across settings
Absolute Relative Error16.1
42
3D Geometry Estimation and ReconstructionSpatialBench Medium
AbsRel0.091
42
3D ReconstructionETH3D
F1 Score84
35
Showing 10 of 67 rows

Other info

Follow for update