Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LongSplat: Online Generalizable 3D Gaussian Splatting from Long Sequence Images

About

3D Gaussian Splatting achieves high-fidelity novel view synthesis, but its application to online long-sequence scenarios is still limited. Existing methods either rely on slow per-scene optimization or fail to provide efficient incremental updates, hindering continuous performance. In this paper, we propose LongSplat, an online real-time 3D Gaussian reconstruction framework designed for long-sequence image input. The core idea is a streaming update mechanism that incrementally integrates current-view observations while selectively compressing redundant historical Gaussians. Crucial to this mechanism is our Gaussian-Image Representation (GIR), a representation that encodes 3D Gaussian parameters into a structured, image-like 2D format. GIR simultaneously enables efficient fusion of current-view and historical Gaussians and identity-aware redundancy compression. These functions enable online reconstruction and adapt the model to long sequences without overwhelming memory or computational costs. Furthermore, we leverage an existing image compression method to guide the generation of more compact and higher-quality 3D Gaussians. Extensive evaluations demonstrate that LongSplat achieves state-of-the-art efficiency-quality trade-offs in real-time novel view synthesis, delivering real-time reconstruction while reducing Gaussian counts by 44\% compared to existing per-pixel Gaussian prediction methods.

Guichen Huang, Ruoyu Wang, Xiangjun Gao, Che Sun, Yuwei Wu, Shenghua Gao, Yunde Jia• 2025

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisDL3DV 32 views
PSNR22.478
13
Novel View SynthesisDL3DV 64 views
PSNR22.264
13
Novel View SynthesisDL3DV 128 views
PSNR21.779
13
Novel View SynthesisDL3DV 256 views
PSNR20.743
13
Novel View SynthesisScanNet out-of-distribution 32v views
PSNR25.426
8
Novel View SynthesisDL3DV 90v views
PSNR21.556
7
Novel View SynthesisDL3DV 180v views
PSNR21.166
7
Novel View SynthesisDL3DV 270v views
PSNR20.598
7
Novel View SynthesisScanNet++ 512v (test)
PSNR18.514
7
Novel View SynthesisScanNet++ 256v (test)
PSNR19.331
7
Showing 10 of 12 rows

Other info

Follow for update