Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

EVER: Exact Volumetric Ellipsoid Rendering for Real-time View Synthesis

About

We present Exact Volumetric Ellipsoid Rendering (EVER), a method for real-time differentiable emission-only volume rendering. Unlike recent rasterization based approach by 3D Gaussian Splatting (3DGS), our primitive based representation allows for exact volume rendering, rather than alpha compositing 3D Gaussian billboards. As such, unlike 3DGS our formulation does not suffer from popping artifacts and view dependent density, but still achieves frame rates of $\sim\!30$ FPS at 720p on an NVIDIA RTX4090. Since our approach is built upon ray tracing it enables effects such as defocus blur and camera distortion (e.g. such as from fisheye cameras), which are difficult to achieve by rasterization. We show that our method is more accurate with fewer blending issues than 3DGS and follow-up work on view-consistent rendering, especially on the challenging large-scale scenes from the Zip-NeRF dataset where it achieves sharpest results among real-time techniques.

Alexander Mai, Peter Hedman, George Kopanas, Dor Verbin, David Futschik, Qiangeng Xu, Falko Kuester, Jonathan T. Barron, Yinda Zhang• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisTanks&Temples (test)
PSNR22.59
239
Novel View SynthesisMip-NeRF 360 (test)
PSNR27.51
166
Novel View SynthesisMip-NeRF360
PSNR27.51
104
Novel View SynthesisMip-NeRF360 (test)
PSNR25.6
58
Novel View SynthesisDeepBlending (test)
PSNR28.12
43
Novel View SynthesisZipNeRF 1/8 Fisheye 1.0 (test)
PSNR25.17
8
Novel View SynthesisZipNeRF 1/4 Pinhole 1.0 (test)
PSNR26.45
8
Novel View SynthesisMipNeRF360 1 (test)
PSNR27.51
7
Novel View SynthesisMipNeRF360 standard (test)
PSNR27.51
7
Novel View SynthesisZip-NeRF (4 large scenes)
PSNR26.58
5
Showing 10 of 18 rows

Other info

Follow for update