Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

NerfAcc: Efficient Sampling Accelerates NeRFs

About

Optimizing and rendering Neural Radiance Fields is computationally expensive due to the vast number of samples required by volume rendering. Recent works have included alternative sampling approaches to help accelerate their methods, however, they are often not the focus of the work. In this paper, we investigate and compare multiple sampling approaches and demonstrate that improved sampling is generally applicable across NeRF variants under an unified concept of transmittance estimator. To facilitate future experiments, we develop NerfAcc, a Python toolbox that provides flexible APIs for incorporating advanced sampling methods into NeRF related methods. We demonstrate its flexibility by showing that it can reduce the training time of several recent NeRF methods by 1.5x to 20x with minimal modifications to the existing codebase. Additionally, highly customized NeRFs, such as Instant-NGP, can be implemented in native PyTorch using NerfAcc.

Ruilong Li, Hang Gao, Matthew Tancik, Angjoo Kanazawa• 2023

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisLLFF (test)
PSNR26.01
91
Novel View SynthesisSynthetic-NeRF (test)
PSNR30.21
53
Neural Radiance Field ReconstructionBlender dataset
PSNR32.55
7
Dynamic Scene ReconstructionEndoNeRF Cutting
PSNR38.287
5
Sampling EfficiencySynthetic-NeRF (averaged over 8 scenes)
Samples/Ray32
5
Dynamic Scene ReconstructionEndoNeRF Pulling
PSNR37.308
5
Dynamic Scene ReconstructionStereoMIS intestine
PSNR29.024
5
Dynamic Scene ReconstructionStereoMIS liver
PSNR26.174
5
Showing 8 of 8 rows

Other info

Follow for update