AdaNeRF: Adaptive Sampling for Real-time Rendering of Neural Radiance Fields

07/21/2022
by   Andreas Kurz, et al.
0

Novel view synthesis has recently been revolutionized by learning neural radiance fields directly from sparse observations. However, rendering images with this new paradigm is slow due to the fact that an accurate quadrature of the volume rendering equation requires a large number of samples for each ray. Previous work has mainly focused on speeding up the network evaluations that are associated with each sample point, e.g., via caching of radiance values into explicit spatial data structures, but this comes at the expense of model compactness. In this paper, we propose a novel dual-network architecture that takes an orthogonal direction by learning how to best reduce the number of required sample points. To this end, we split our network into a sampling and shading network that are jointly trained. Our training scheme employs fixed sample positions along each ray, and incrementally introduces sparsity throughout training to achieve high quality even at low sample counts. After fine-tuning with the target number of samples, the resulting compact neural representation can be rendered in real-time. Our experiments demonstrate that our approach outperforms concurrent compact neural representations in terms of quality and frame rate and performs on par with highly efficient hybrid representations. Code and supplementary material is available at https://thomasneff.github.io/adanerf.

READ FULL TEXT
research
03/04/2021

DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks

The recent research explosion around implicit neural representations, su...
research
08/22/2023

Efficient View Synthesis with Neural Radiance Distribution Field

Recent work on Neural Radiance Fields (NeRF) has demonstrated significan...
research
12/02/2021

Learning Neural Light Fields with Ray-Space Embedding Networks

Neural radiance fields (NeRFs) produce state-of-the-art view synthesis r...
research
05/08/2023

NerfAcc: Efficient Sampling Accelerates NeRFs

Optimizing and rendering Neural Radiance Fields is computationally expen...
research
06/09/2021

NeRF in detail: Learning to sample for view synthesis

Neural radiance fields (NeRF) methods have demonstrated impressive novel...
research
11/01/2021

Generative Occupancy Fields for 3D Surface-Aware Image Synthesis

The advent of generative radiance fields has significantly promoted the ...
research
07/28/2023

Dynamic PlenOctree for Adaptive Sampling Refinement in Explicit NeRF

The explicit neural radiance field (NeRF) has gained considerable intere...

Please sign up or login with your details

Forgot password? Click here to reset