Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussians

About

The advancement of real-time 3D scene reconstruction and novel view synthesis has been significantly propelled by 3D Gaussian Splatting (3DGS). However, effectively training large-scale 3DGS and rendering it in real-time across various scales remains challenging. This paper introduces CityGaussian (CityGS), which employs a novel divide-and-conquer training approach and Level-of-Detail (LoD) strategy for efficient large-scale 3DGS training and rendering. Specifically, the global scene prior and adaptive training data selection enables efficient training and seamless fusion. Based on fused Gaussian primitives, we generate different detail levels through compression, and realize fast rendering across various scales through the proposed block-wise detail levels selection and aggregation strategy. Extensive experimental results on large-scale scenes demonstrate that our approach attains state-of-theart rendering quality, enabling consistent real-time rendering of largescale scenes across vastly different scales. Our project page is available at https://dekuliutesla.github.io/citygs/.

Yang Liu, He Guan, Chuanchen Luo, Lue Fan, Naiyan Wang, Junran Peng, Zhaoxiang Zhang• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisMip-NeRF360
PSNR27.35
51
Novel View SynthesisSmallCity
PSNR25.13
38
View SynthesisUrbanScene3D Sci-Art
PSNR21.39
32
Novel View SynthesisMatrixCity
PSNR27.44
25
Novel View SynthesisResidence
PSNR22.03
19
Novel View SynthesisBuilding
PSNR21.96
19
Novel View SynthesisRubble
PSNR25.59
19
Novel View Synthesislarge-scale real-world scanned scenes
SSIM81.5
16
Novel View SynthesisMatrixCity aerial
PSNR28.61
14
Novel View SynthesisRubble (test)
SSIM0.813
13
Showing 10 of 35 rows

Other info

Follow for update