Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussians

About

The advancement of real-time 3D scene reconstruction and novel view synthesis has been significantly propelled by 3D Gaussian Splatting (3DGS). However, effectively training large-scale 3DGS and rendering it in real-time across various scales remains challenging. This paper introduces CityGaussian (CityGS), which employs a novel divide-and-conquer training approach and Level-of-Detail (LoD) strategy for efficient large-scale 3DGS training and rendering. Specifically, the global scene prior and adaptive training data selection enables efficient training and seamless fusion. Based on fused Gaussian primitives, we generate different detail levels through compression, and realize fast rendering across various scales through the proposed block-wise detail levels selection and aggregation strategy. Extensive experimental results on large-scale scenes demonstrate that our approach attains state-of-theart rendering quality, enabling consistent real-time rendering of largescale scenes across vastly different scales. Our project page is available at https://dekuliutesla.github.io/citygs/.

Yang Liu, He Guan, Chuanchen Luo, Lue Fan, Naiyan Wang, Junran Peng, Zhaoxiang Zhang• 2024

Related benchmarks

TaskDatasetResultRank
View SynthesisUrbanScene3D Sci-Art
PSNR21.39
32
Novel View SynthesisRubble (test)
SSIM0.813
13
Novel View SynthesisBuilding Mill19 (test)
SSIM77.8
13
Novel View SynthesisUrbanScene3D Residence (test)
SSIM81.3
13
Surface ReconstructionMill19 Rubble
PSNR26.15
11
View SynthesisMill 19 Rubble
PSNR25.77
10
Surface ReconstructionUrbanScene3D Sci-Art
PSNR22.77
10
Surface ReconstructionMill19 Building
PSNR22.76
9
Scene ReconstructionGauU-Scene Russian Building
PSNR24.37
9
3D ReconstructionMatrixCity aerial
PSNR27.46
9
Showing 10 of 25 rows

Other info

Follow for update