Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Expansive Supervision for Neural Radiance Field

About

Neural Radiance Field (NeRF) has achieved remarkable success in creating immersive media representations through its exceptional reconstruction capabilities. However, the computational demands of dense forward passes and volume rendering during training continue to challenge its real-world applications. In this paper, we introduce Expansive Supervision to reduce time and memory costs during NeRF training from the perspective of partial ray selection for supervision. Specifically, we observe that training errors exhibit a long-tail distribution correlated with image content. Based on this observation, our method selectively renders a small but crucial subset of pixels and expands their values to estimate errors across the entire area for each iteration. Compared to conventional supervision, our approach effectively bypasses redundant rendering processes, resulting in substantial reductions in both time and memory consumption. Experimental results demonstrate that integrating Expansive Supervision within existing state-of-the-art acceleration frameworks achieves 52% memory savings and 16% time savings while maintaining comparable visual quality.

Weixiang Zhang, Shuzhao Xie, Shijia Ge, Wei Yao, Chen Tang, Zhi Wang• 2024

Related benchmarks

TaskDatasetResultRank
Image fittingKodak (test)
PSNR36.12
39
Image ReconstructionImage Fitting (test)
Time (sec)5.08
18
2D text fitting2D synthesized text
PSNR36.92
8
Showing 3 of 3 rows

Other info

Follow for update