Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PocketGS: On-Device Training of 3D Gaussian Splatting for High Perceptual Modeling

About

While 3D Gaussian Splatting (3DGS) enables real-time rendering, its training demands workstation-level compute and memory, making mobile deployment impractical under minute-scale time budgets and limited peak memory. We present PocketGS, a mobile scene modeling paradigm that enables on-device 3DGS training under these tightly coupled constraints while preserving high-fidelity reconstruction. PocketGS resolves the fundamental tension between training efficiency, memory compactness, and modeling quality through three co-designed operators: $\mathcal{G}$ builds geometry-faithful point-cloud priors; $\mathcal{I}$ injects local surface statistics to seed anisotropic Gaussians, thereby reducing early conditioning gaps; and $\mathcal{T}$ unrolls alpha compositing with cached intermediates and index-mapped gradient scattering for stable mobile backpropagation. Extensive experiments demonstrate that PocketGS outperforms the powerful mainstream workstation 3DGS baseline under mobile budgets, delivering high-quality reconstructions and enabling a fully on-device, practical capture-to-rendering workflow.

Wenzhi Guo, Guangchi Fang, Shu Yang, Bing Wang• 2026

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisLLFF (test)
PSNR23.54
96
Novel View SynthesisNeRF Synthetic (test)
PSNR24.32
46
Novel View SynthesisMobileScan (test)
PSNR23.67
3
Showing 3 of 3 rows

Other info

Follow for update