Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DIVeR: Real-time and Accurate Neural Radiance Fields with Deterministic Integration for Volume Rendering

About

DIVeR builds on the key ideas of NeRF and its variants -- density models and volume rendering -- to learn 3D object models that can be rendered realistically from small numbers of images. In contrast to all previous NeRF methods, DIVeR uses deterministic rather than stochastic estimates of the volume rendering integral. DIVeR's representation is a voxel based field of features. To compute the volume rendering integral, a ray is broken into intervals, one per voxel; components of the volume rendering integral are estimated from the features for each interval using an MLP, and the components are aggregated. As a result, DIVeR can render thin translucent structures that are missed by other integrators. Furthermore, DIVeR's representation has semantics that is relatively exposed compared to other such methods -- moving feature vectors around in the voxel space results in natural edits. Extensive qualitative and quantitative comparisons to current state-of-the-art methods show that DIVeR produces models that (1) render at or above state-of-the-art quality, (2) are very small without being baked, (3) render very fast without being baked, and (4) can be edited in natural ways.

Liwen Wu, Jae Yong Lee, Anand Bhattad, Yuxiong Wang, David Forsyth• 2021

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisNeRF Synthetic
PSNR32.16
92
Novel View SynthesisTanks&Temples
PSNR28.16
52
Offline renderingNeRF Synthetic (test)
PSNR32.32
40
Novel View SynthesisNeRF-synthetic original (test)
PSNR32.12
25
View SynthesisTanks&Temples (test)
PSNR28.18
13
Novel View SynthesisTanks&Temples
PSNR28.18
7
Offline renderingBlendedMVS (test)
PSNR27.25
3
Showing 7 of 7 rows

Other info

Code

Follow for update