Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

HD-VGGT: High-Resolution Visual Geometry Transformer

About

High-resolution imagery is essential for accurate 3D reconstruction, as many geometric details only emerge at fine spatial scales. Recent feed-forward approaches, such as the Visual Geometry Grounded Transformer (VGGT), have demonstrated the ability to infer scene geometry from large collections of images in a single forward pass. However, scaling these models to high-resolution inputs remains challenging: the number of tokens in transformer architectures grows rapidly with both image resolution and the number of views, leading to prohibitive computational and memory costs. Moreover, we observe that visually ambiguous regions, such as repetitive patterns, weak textures, or specular surfaces, often produce unstable feature tokens that degrade geometric inference, especially at higher resolutions. We introduce HD-VGGT, a dual-branch architecture for efficient and robust high-resolution 3D reconstruction. A low-resolution branch predicts a coarse, globally consistent geometry, while a high-resolution branch refines details via a learned feature upsampling module. To handle unstable tokens, we propose Feature Modulation, which suppresses unreliable features early in the transformer. HD-VGGT leverages high-resolution images and supervision without full-resolution transformer costs, achieving state-of-the-art reconstruction quality.

Tianrun Chen, Yuanqi Hu, Yidong Han, Hanjie Xu, Deyi Ji, Qi Zhu, Chunan Yu, Xin Zhang, Cheng Chen, Chaotao Ding, Ying Zang, Xuanfu Li, Jin Ma, Lanyun Zhu• 2026

Related benchmarks

TaskDatasetResultRank
Camera pose estimationTUM-dynamic
ATE0.009
163
Monocular Depth EstimationNYU V2
Delta 1 Acc98.8
131
Monocular Depth EstimationScanNet
AbsRel4.9
81
Camera pose estimationCO3D v2
AUC@3090.4
78
Point Map Estimation7 Scenes--
47
Monocular Depth EstimationScanNet (test)
Abs Rel0.102
30
Point Map EstimationDTU
Accuracy (Mean)95.3
23
Camera pose estimationSintel outdoor, dynamic
ATE0.071
7
Point Map ReconstructionNRGBD scene
Accuracy Mean (cm)2.4
7
Camera pose estimationRealEstate10K mixed static
RRA@3099.99
7
Showing 10 of 10 rows

Other info

Follow for update