Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Ev-GS: Event-based Gaussian splatting for Efficient and Accurate Radiance Field Rendering

About

Computational neuromorphic imaging (CNI) with event cameras offers advantages such as minimal motion blur and enhanced dynamic range, compared to conventional frame-based methods. Existing event-based radiance field rendering methods are built on neural radiance field, which is computationally heavy and slow in reconstruction speed. Motivated by the two aspects, we introduce Ev-GS, the first CNI-informed scheme to infer 3D Gaussian splatting from a monocular event camera, enabling efficient novel view synthesis. Leveraging 3D Gaussians with pure event-based supervision, Ev-GS overcomes challenges such as the detection of fast-moving objects and insufficient lighting. Experimental results show that Ev-GS outperforms the method that takes frame-based signals as input by rendering realistic views with reduced blurring and improved visual quality. Moreover, it demonstrates competitive reconstruction quality and reduced computing occupancy compared to existing methods, which paves the way to a highly efficient CNI approach for signal processing.

Jingqian Wu, Shuo Zhu, Chutian Wang, Edmund Y. Lam• 2024

Related benchmarks

TaskDatasetResultRank
Radiance Field ReconstructionReal Dataset Baseball scene, 28 lux
PSNR15.82
10
Radiance Field ReconstructionReal Dataset Lion scene, 32 lux
PSNR14.95
10
Radiance Field ReconstructionReal Dataset House scene, 38 lux
PSNR13.27
10
Radiance Field ReconstructionReal Dataset Panda scene, 17 lux
PSNR12.37
10
Radiance Field ReconstructionReal Dataset Badminton scene, 14 lux
PSNR10.89
10
Radiance Field ReconstructionReal Dataset Cat scene, 16 lux
PSNR10.58
10
Novel View Synthesis4 synthetic scenes (mean)
PSNR26.6
2
Showing 7 of 7 rows

Other info

Follow for update