Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SpotlessSplats: Ignoring Distractors in 3D Gaussian Splatting

About

3D Gaussian Splatting (3DGS) is a promising technique for 3D reconstruction, offering efficient training and rendering speeds, making it suitable for real-time applications.However, current methods require highly controlled environments (no moving people or wind-blown elements, and consistent lighting) to meet the inter-view consistency assumption of 3DGS. This makes reconstruction of real-world captures problematic. We present SpotLessSplats, an approach that leverages pre-trained and general-purpose features coupled with robust optimization to effectively ignore transient distractors. Our method achieves state-of-the-art reconstruction quality both visually and quantitatively, on casual captures. Additional results available at: https://spotlesssplats.github.io

Sara Sabour, Lily Goli, George Kopanas, Mark Matthews, Dmitry Lagun, Leonidas Guibas, Alec Jacobson, David J. Fleet, Andrea Tagliasacchi• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisD-RE10K-iPhone full-image fidelity (test)
PSNR18.86
26
Novel View SynthesisD-RE10K static regions only (test)
PSNR18.05
26
Novel View SynthesisRobustNeRF Baby Yoda scene
LPIPS0.1
8
Novel View SynthesisRobustNeRF (test)
PSNR (Android)24.2
6
Novel View SynthesisNeRF On-the-go--
6
Novel View SynthesisRobustNeRF Statue
PSNR22.54
5
Novel View SynthesisRobustNeRF Android
PSNR25.05
5
Novel View SynthesisNeRF On-the-go Corner 1.0 (test)
PSNR21.55
5
Novel View SynthesisNeRF On-the-go Patio 1.0 (test)
PSNR23.52
5
Novel View SynthesisNeRF On-the-go Mountain 1.0 (test)
PSNR19.84
5
Showing 10 of 17 rows

Other info

Follow for update