Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Occam's LGS: An Efficient Approach for Language Gaussian Splatting

About

TL;DR: Gaussian Splatting is a widely adopted approach for 3D scene representation, offering efficient, high-quality reconstruction and rendering. A key reason for its success is the simplicity of representing scenes with sets of Gaussians, making it interpretable and adaptable. To enhance understanding beyond visual representation, recent approaches extend Gaussian Splatting with semantic vision-language features, enabling open-set tasks. Typically, these language features are aggregated from multiple 2D views, however, existing methods rely on cumbersome techniques, resulting in high computational costs and longer training times. In this work, we show that the complicated pipelines for language 3D Gaussian Splatting are simply unnecessary. Instead, we follow a probabilistic formulation of Language Gaussian Splatting and apply Occam's razor to the task at hand, leading to a highly efficient weighted multi-view feature aggregation technique. Doing so offers us state-of-the-art results with a speed-up of two orders of magnitude without any compression, allowing for easy scene manipulation. Project Page: https://insait-institute.github.io/OccamLGS/

Jiahuan Cheng, Jan-Nico Zaech, Luc Van Gool, Danda Pani Paudel• 2024

Related benchmarks

TaskDatasetResultRank
3D Semantic SegmentationScanNet++
mIoU (20 classes)34.08
31
3D Semantic SegmentationScanNet 15 classes
mIoU35.04
17
3D Semantic SegmentationScanNet
mIoU (10 classes)0.4214
17
3D Semantic SegmentationScanNet 10 classes
mIoU42.14
17
Open-vocabulary 3D object selectionLERF
Ramen Score51
16
3D object selectionLERF figurines scene
Peak VRAM12
14
3D Semantic SegmentationScanNet200
mIoU (70 classes)20.32
11
3D Semantic SegmentationScanNet 19 classes
mIoU30.49
10
3D Semantic SegmentationScanNet 200 70 classes
mIoU20.32
10
3D Semantic SegmentationScanNet ➜ Replica 48 classes (test)
mIoU16.19
8
Showing 10 of 15 rows

Other info

Follow for update