Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

CityGaussianV2: Efficient and Geometrically Accurate Reconstruction for Large-Scale Scenes

About

Recently, 3D Gaussian Splatting (3DGS) has revolutionized radiance field reconstruction, manifesting efficient and high-fidelity novel view synthesis. However, accurately representing surfaces, especially in large and complex scenarios, remains a significant challenge due to the unstructured nature of 3DGS. In this paper, we present CityGaussianV2, a novel approach for large-scale scene reconstruction that addresses critical challenges related to geometric accuracy and efficiency. Building on the favorable generalization capabilities of 2D Gaussian Splatting (2DGS), we address its convergence and scalability issues. Specifically, we implement a decomposed-gradient-based densification and depth regression technique to eliminate blurry artifacts and accelerate convergence. To scale up, we introduce an elongation filter that mitigates Gaussian count explosion caused by 2DGS degeneration. Furthermore, we optimize the CityGaussian pipeline for parallel training, achieving up to 10$\times$ compression, at least 25% savings in training time, and a 50% decrease in memory usage. We also established standard geometry benchmarks under large-scale scenes. Experimental results demonstrate that our method strikes a promising balance between visual quality, geometric accuracy, as well as storage and training costs. The project page is available at https://dekuliutesla.github.io/CityGaussianV2/.

Yang Liu, Chuanchen Luo, Zhongkai Mao, Junran Peng, Zhaoxiang Zhang• 2024

Related benchmarks

TaskDatasetResultRank
View SynthesisUrbanScene3D Sci-Art
PSNR20.66
22
Novel View SynthesisUrbanScene3D Residence (test)
SSIM76.9
13
Novel View SynthesisBuilding Mill19 (test)
SSIM65
13
Novel View SynthesisRubble (test)
SSIM0.72
13
Novel View SynthesisGauU-Scene Russian Building
SSIM0.784
8
Geometric ReconstructionGauU-Scene Village
Precision58
7
Geometric ReconstructionGauU-Scene (College)
Precision57.7
7
Novel View SynthesisGauU-Scene Residence
SSIM0.742
7
Geometric ReconstructionGauU-Scene Campus
Precision48.6
7
Geometry ReconstructionGauU-Scene Russian Building
Precision0.56
7
Showing 10 of 16 rows

Other info

Follow for update