Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ActiveGS: Active Scene Reconstruction Using Gaussian Splatting

About

Robotics applications often rely on scene reconstructions to enable downstream tasks. In this work, we tackle the challenge of actively building an accurate map of an unknown scene using an RGB-D camera on a mobile platform. We propose a hybrid map representation that combines a Gaussian splatting map with a coarse voxel map, leveraging the strengths of both representations: the high-fidelity scene reconstruction capabilities of Gaussian splatting and the spatial modelling strengths of the voxel map. At the core of our framework is an effective confidence modelling technique for the Gaussian splatting map to identify under-reconstructed areas, while utilising spatial information from the voxel map to target unexplored areas and assist in collision-free path planning. By actively collecting scene information in under-reconstructed and unexplored areas for map updates, our approach achieves superior Gaussian splatting reconstruction results compared to state-of-the-art approaches. Additionally, we demonstrate the real-world applicability of our framework using an unmanned aerial vehicle.

Liren Jin, Xingguang Zhong, Yue Pan, Jens Behley, Cyrill Stachniss, Marija Popovi\'c• 2024

Related benchmarks

TaskDatasetResultRank
Mesh ReconstructionReplica Room 0--
21
Mesh ReconstructionReplica Room 1
Completion (cm)1.063
16
Mesh ReconstructionReplica Office 0
Completion (cm)1.004
16
Mesh ReconstructionReplica Room 2
Completion Ratio [< δ]0.97
16
RenderingReplica Room 0
PSNR28.14
11
RenderingReplica Room 1
PSNR29.55
11
RenderingReplica Room 2
PSNR30.01
11
RenderingReplica Office 0
PSNR34.62
11
RenderingReplica Office 2
PSNR30.1
11
RenderingReplica Office 3
PSNR29.91
11
Showing 10 of 17 rows

Other info

Follow for update