Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

FLoD: Integrating Flexible Level of Detail into 3D Gaussian Splatting for Customizable Rendering

About

3D Gaussian Splatting (3DGS) and its subsequent works are restricted to specific hardware setups, either on only low-cost or on only high-end configurations. Approaches aimed at reducing 3DGS memory usage enable rendering on low-cost GPU but compromise rendering quality, which fails to leverage the hardware capabilities in the case of higher-end GPU. Conversely, methods that enhance rendering quality require high-end GPU with large VRAM, making such methods impractical for lower-end devices with limited memory capacity. Consequently, 3DGS-based works generally assume a single hardware setup and lack the flexibility to adapt to varying hardware constraints. To overcome this limitation, we propose Flexible Level of Detail (FLoD) for 3DGS. FLoD constructs a multi-level 3DGS representation through level-specific 3D scale constraints, where each level independently reconstructs the entire scene with varying detail and GPU memory usage. A level-by-level training strategy is introduced to ensure structural consistency across levels. Furthermore, the multi-level structure of FLoD allows selective rendering of image regions at different detail levels, providing additional memory-efficient rendering options. To our knowledge, among prior works which incorporate the concept of Level of Detail (LoD) with 3DGS, FLoD is the first to follow the core principle of LoD by offering adjustable options for a broad range of GPU settings. Experiments demonstrate that FLoD provides various rendering options with trade-offs between quality and memory usage, enabling real-time rendering under diverse memory constraints. Furthermore, we show that FLoD generalizes to different 3DGS frameworks, indicating its potential for integration into future state-of-the-art developments.

Yunji Seo, Young Sun Choi, Hyun Seung Son, Youngjung Uh• 2024

Related benchmarks

TaskDatasetResultRank
View SynthesisUrbanScene3D Sci-Art
PSNR22.46
32
Novel View SynthesisGauU-Scene Residence
SSIM0.743
13
Novel View SynthesisGauU-Scene Modern Building
SSIM0.742
13
Novel View SynthesisMatrixCity Block Small
PSNR25.06
12
Novel View SynthesisGauUScene College
PSNR25.28
6
Novel View SynthesisUrbanScene Residence
PSNR21.57
6
Showing 6 of 6 rows

Other info

Follow for update