Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SpotlessSplats: Ignoring Distractors in 3D Gaussian Splatting

About

3D Gaussian Splatting (3DGS) is a promising technique for 3D reconstruction, offering efficient training and rendering speeds, making it suitable for real-time applications.However, current methods require highly controlled environments (no moving people or wind-blown elements, and consistent lighting) to meet the inter-view consistency assumption of 3DGS. This makes reconstruction of real-world captures problematic. We present SpotLessSplats, an approach that leverages pre-trained and general-purpose features coupled with robust optimization to effectively ignore transient distractors. Our method achieves state-of-the-art reconstruction quality both visually and quantitatively, on casual captures. Additional results available at: https://spotlesssplats.github.io

Sara Sabour, Lily Goli, George Kopanas, Mark Matthews, Dmitry Lagun, Leonidas Guibas, Alec Jacobson, David J. Fleet, Andrea Tagliasacchi• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisD-RE10K-iPhone full-image fidelity (test)
PSNR18.86
26
Novel View SynthesisD-RE10K static regions only (test)
PSNR18.05
26
Novel View SynthesisRobustNeRF Baby Yoda scene
LPIPS0.071
20
Novel View SynthesisNeRF On-the-go (test)
Corner Score17.05
18
Novel View SynthesisRobustNeRF
Android Quality Score19.69
18
Novel View SynthesisRobustNeRF Android
PSNR25.05
17
Novel View SynthesisRobustNeRF Statue
PSNR22.81
17
Novel View SynthesisRobustNeRF Crab
PSNR35.85
16
Novel View SynthesisOn-the-go Dataset
PSNR (Mountain)21.99
12
Novel View SynthesisRobustNeRF Avg.
PSNR29.51
12
Showing 10 of 26 rows

Other info

Follow for update