FisherRF: Active View Selection and Uncertainty Quantification for Radiance Fields using Fisher Information
About
This study addresses the challenging problem of active view selection and uncertainty quantification within the domain of Radiance Fields. Neural Radiance Fields (NeRF) have greatly advanced image rendering and reconstruction, but the cost of acquiring images poses the need to select the most informative viewpoints efficiently. Existing approaches depend on modifying the model architecture or hypothetical perturbation field to indirectly approximate the model uncertainty. However, selecting views from indirect approximation does not guarantee optimal information gain for the model. By leveraging Fisher Information, we directly quantify observed information on the parameters of Radiance Fields and select candidate views by maximizing the Expected Information Gain(EIG). Our method achieves state-of-the-art results on multiple tasks, including view selection, active mapping, and uncertainty quantification, demonstrating its potential to advance the field of Radiance Fields.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Dynamic and Semantic 3DGS Active Training | Neu3D average across five dynamic scenes | SSIM0.9186 | 10 | |
| Batch View Selection | Blender (test) | PSNR27.64 | 7 | |
| Batch View Selection | Mip-NeRF360 (test) | PSNR20.5 | 7 | |
| Single View Selection | Blender Dataset (test) | PSNR24.59 | 7 | |
| Single View Selection | Mip-Nerf360 20 views | PSNR20.89 | 7 | |
| Single View Selection | Mip-NeRF360 average over nine scenes 10 views | PSNR16.81 | 7 | |
| Keyframe Selection | Mip-NeRF360 (test) | PSNR15.66 | 7 | |
| Active View Selection | NeRF Synthetic | PSNR25.19 | 6 | |
| Active View Selection | Deep Blending & Tank and Temples (test) | PSNR19.455 | 6 | |
| Dynamic and semantic 3DGS | Neu3D average across five dynamic scenes | SSIM0.9186 | 4 |