Occam's LGS: An Efficient Approach for Language Gaussian Splatting
About
TL;DR: Gaussian Splatting is a widely adopted approach for 3D scene representation, offering efficient, high-quality reconstruction and rendering. A key reason for its success is the simplicity of representing scenes with sets of Gaussians, making it interpretable and adaptable. To enhance understanding beyond visual representation, recent approaches extend Gaussian Splatting with semantic vision-language features, enabling open-set tasks. Typically, these language features are aggregated from multiple 2D views, however, existing methods rely on cumbersome techniques, resulting in high computational costs and longer training times. In this work, we show that the complicated pipelines for language 3D Gaussian Splatting are simply unnecessary. Instead, we follow a probabilistic formulation of Language Gaussian Splatting and apply Occam's razor to the task at hand, leading to a highly efficient weighted multi-view feature aggregation technique. Doing so offers us state-of-the-art results with a speed-up of two orders of magnitude without any compression, allowing for easy scene manipulation. Project Page: https://insait-institute.github.io/OccamLGS/
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 3D Semantic Segmentation | ScanNet++ | mIoU (20 classes)34.08 | 31 | |
| 3D Semantic Segmentation | ScanNet 15 classes | mIoU35.04 | 17 | |
| 3D Semantic Segmentation | ScanNet | mIoU (10 classes)0.4214 | 17 | |
| 3D Semantic Segmentation | ScanNet 10 classes | mIoU42.14 | 17 | |
| Open-vocabulary 3D object selection | LERF | Ramen Score51 | 16 | |
| 3D object selection | LERF figurines scene | Peak VRAM12 | 14 | |
| 3D Semantic Segmentation | ScanNet200 | mIoU (70 classes)20.32 | 11 | |
| 3D Semantic Segmentation | ScanNet 19 classes | mIoU30.49 | 10 | |
| 3D Semantic Segmentation | ScanNet 200 70 classes | mIoU20.32 | 10 | |
| 3D Semantic Segmentation | ScanNet ➜ Replica 48 classes (test) | mIoU16.19 | 8 |