Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher Information

About

This study addresses the challenging problem of active view selection and uncertainty quantification within the domain of Radiance Fields. Neural Radiance Fields (NeRF) have greatly advanced image rendering and reconstruction, but the cost of acquiring images poses the need to select the most informative viewpoints efficiently. Existing approaches depend on modifying the model architecture or hypothetical perturbation field to indirectly approximate the model uncertainty. However, selecting views from indirect approximation does not guarantee optimal information gain for the model. By leveraging Fisher Information, we directly quantify observed information on the parameters of Radiance Fields and select candidate views by maximizing the Expected Information Gain(EIG). Our method achieves state-of-the-art results on multiple tasks, including view selection, active mapping, and uncertainty quantification, demonstrating its potential to advance the field of Radiance Fields.

Wen Jiang, Boshu Lei, Kostas Daniilidis• 2023

Related benchmarks

TaskDatasetResultRank
Dynamic and Semantic 3DGS Active TrainingNeu3D average across five dynamic scenes
SSIM0.9186
10
Batch View SelectionBlender (test)
PSNR27.64
7
Batch View SelectionMip-NeRF360 (test)
PSNR20.5
7
Single View SelectionBlender Dataset (test)
PSNR24.59
7
Single View SelectionMip-Nerf360 20 views
PSNR20.89
7
Single View SelectionMip-NeRF360 average over nine scenes 10 views
PSNR16.81
7
Keyframe SelectionMip-NeRF360 (test)
PSNR15.66
7
Active View SelectionNeRF Synthetic
PSNR25.19
6
Active View SelectionDeep Blending & Tank and Temples (test)
PSNR19.455
6
Dynamic and semantic 3DGSNeu3D average across five dynamic scenes
SSIM0.9186
4
Showing 10 of 11 rows

Other info

Follow for update