Efficient Ray Sampling for Radiance Fields Reconstruction

08/29/2023
by   Shilei Sun, et al.
0

Accelerating neural radiance fields training is of substantial practical value, as the ray sampling strategy profoundly impacts network convergence. More efficient ray sampling can thus directly enhance existing NeRF models' training efficiency. We therefore propose a novel ray sampling approach for neural radiance fields that improves training efficiency while retaining photorealistic rendering results. First, we analyze the relationship between the pixel loss distribution of sampled rays and rendering quality. This reveals redundancy in the original NeRF's uniform ray sampling. Guided by this finding, we develop a sampling method leveraging pixel regions and depth boundaries. Our main idea is to sample fewer rays in training views, yet with each ray more informative for scene fitting. Sampling probability increases in pixel areas exhibiting significant color and depth variation, greatly reducing wasteful rays from other regions without sacrificing precision. Through this method, not only can the convergence of the network be accelerated, but the spatial geometry of a scene can also be perceived more accurately. Rendering outputs are enhanced, especially for texture-complex regions. Experiments demonstrate that our method significantly outperforms state-of-the-art techniques on public benchmark datasets.

READ FULL TEXT

page 1

page 6

page 7

page 11

page 12

page 13

page 14

page 15

research
02/21/2023

Differentiable Rendering with Reparameterized Volume Sampling

In view synthesis, a neural radiance field approximates underlying densi...
research
11/29/2021

HDR-NeRF: High Dynamic Range Neural Radiance Fields

We present High Dynamic Range Neural Radiance Fields (HDR-NeRF) to recov...
research
12/02/2021

Learning Neural Light Fields with Ray-Space Embedding Networks

Neural radiance fields (NeRFs) produce state-of-the-art view synthesis r...
research
07/05/2021

Ray-ONet: Efficient 3D Reconstruction From A Single RGB Image

We propose Ray-ONet to reconstruct detailed 3D models from monocular ima...
research
08/11/2023

Focused Specific Objects NeRF

Most NeRF-based models are designed for learning the entire scene, and c...
research
07/22/2021

Fristograms: Revealing and Exploiting Light Field Internals

In recent years, light field (LF) capture and processing has become an i...
research
07/11/2023

Neural Point-based Volumetric Avatar: Surface-guided Neural Points for Efficient and Photorealistic Volumetric Head Avatar

Rendering photorealistic and dynamically moving human heads is crucial f...

Please sign up or login with your details

Forgot password? Click here to reset