SpotlessSplats: Ignoring Distractors in 3D Gaussian Splatting
About
3D Gaussian Splatting (3DGS) is a promising technique for 3D reconstruction, offering efficient training and rendering speeds, making it suitable for real-time applications.However, current methods require highly controlled environments (no moving people or wind-blown elements, and consistent lighting) to meet the inter-view consistency assumption of 3DGS. This makes reconstruction of real-world captures problematic. We present SpotLessSplats, an approach that leverages pre-trained and general-purpose features coupled with robust optimization to effectively ignore transient distractors. Our method achieves state-of-the-art reconstruction quality both visually and quantitatively, on casual captures. Additional results available at: https://spotlesssplats.github.io
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Novel View Synthesis | D-RE10K-iPhone full-image fidelity (test) | PSNR18.86 | 26 | |
| Novel View Synthesis | D-RE10K static regions only (test) | PSNR18.05 | 26 | |
| Novel View Synthesis | RobustNeRF Baby Yoda scene | LPIPS0.1 | 8 | |
| Novel View Synthesis | RobustNeRF (test) | PSNR (Android)24.2 | 6 | |
| Novel View Synthesis | NeRF On-the-go | -- | 6 | |
| Novel View Synthesis | RobustNeRF Statue | PSNR22.54 | 5 | |
| Novel View Synthesis | RobustNeRF Android | PSNR25.05 | 5 | |
| Novel View Synthesis | NeRF On-the-go Corner 1.0 (test) | PSNR21.55 | 5 | |
| Novel View Synthesis | NeRF On-the-go Patio 1.0 (test) | PSNR23.52 | 5 | |
| Novel View Synthesis | NeRF On-the-go Mountain 1.0 (test) | PSNR19.84 | 5 |