NeRF++: Analyzing and Improving Neural Radiance Fields
About
Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons (MLPs) representing view-invariant opacity and view-dependent color volumes to a set of training images, and samples novel views based on volume rendering techniques. In this technical report, we first remark on radiance fields and their potential ambiguities, namely the shape-radiance ambiguity, and analyze NeRF's success in avoiding such ambiguities. Second, we address a parametrization issue involved in applying NeRF to 360 captures of objects within large-scale, unbounded 3D scenes. Our method improves view synthesis fidelity in this challenging scenario. Code is available at https://github.com/Kai-46/nerfplusplus.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Novel View Synthesis | Tanks&Temples (test) | PSNR19.59 | 239 | |
| Novel View Synthesis | Mip-NeRF 360 (test) | PSNR25.11 | 166 | |
| Novel View Synthesis | MipNeRF 360 Outdoor | PSNR22.76 | 112 | |
| Novel View Synthesis | MipNeRF 360 Indoor | PSNR28.05 | 108 | |
| Novel View Synthesis | Mip-NeRF 360 | PSNR25.112 | 102 | |
| View Synthesis | UrbanScene3D Sci-Art | PSNR20.83 | 22 | |
| View Synthesis | Tanks&Temples (test) | PSNR19.83 | 13 | |
| Novel View Synthesis | Mip-NeRF 360 1.0 (test) | PSNR26.39 | 11 | |
| Novel View Synthesis | outdoor low resolution 1280 x 840 | PSNR23.8 | 11 | |
| Novel View Synthesis | Free | PSNR23.47 | 11 |