Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequences

About

Foundation models for 3D vision have recently demonstrated remarkable capabilities in 3D perception. However, extending these models to large-scale RGB stream 3D reconstruction remains challenging due to memory limitations. In this work, we propose VGGT-Long, a simple yet effective system that pushes the limits of monocular 3D reconstruction to kilometer-scale, unbounded outdoor environments. Our approach addresses the scalability bottlenecks of existing models through a chunk-based processing strategy combined with overlapping alignment and lightweight loop closure optimization. Without requiring camera calibration, depth supervision or model retraining, VGGT-Long achieves trajectory and reconstruction performance comparable to traditional methods. We evaluate our method on KITTI, Waymo, and Virtual KITTI datasets. VGGT-Long not only runs successfully on long RGB sequences where foundation models typically fail, but also produces accurate and consistent geometry across various conditions. Our results highlight the potential of leveraging foundation models for scalable monocular 3D scene in real-world settings, especially for autonomous driving scenarios. Code is available at https://github.com/DengKaiCQ/VGGT-Long.

Kai Deng, Zexin Ti, Jiawei Xu, Jian Yang, Jin Xie• 2025

Related benchmarks

TaskDatasetResultRank
Visual-Inertial OdometryEuRoC (All sequences)
MH1 Error0.579
62
Point Map Estimation7 Scenes
Accuracy (Mean)1.6
47
Visual OdometryTUM-RGBD
freiburg1/desk2 Error0.155
37
Visual OdometryKITTI
KITTI Seq 03 Error6.12
37
Pose EstimationScanNet++--
32
Camera pose estimationTUM RGB-D 36
Error (desk)0.058
26
3D ReconstructionETH3D
F1 Score84
25
Multi-view Point Map EstimationNRGBD
Accuracy (Mean)0.018
25
Pose EstimationTUM-RGBD
ATE0.08
21
Camera Pose LocalizationCambridge Landmarks--
20
Showing 10 of 39 rows

Other info

Follow for update