DeRF: Decomposed Radiance Fields

by   Daniel Rebain, et al.

With the advent of Neural Radiance Fields (NeRF), neural networks can now render novel views of a 3D scene with quality that fools the human eye. Yet, generating these images is very computationally intensive, limiting their applicability in practical scenarios. In this paper, we propose a technique based on spatial decomposition capable of mitigating this issue. Our key observation is that there are diminishing returns in employing larger (deeper and/or wider) networks. Hence, we propose to spatially decompose a scene and dedicate smaller networks for each decomposed part. When working together, these networks can render the whole scene. This allows us near-constant inference time regardless of the number of decomposed parts. Moreover, we show that a Voronoi spatial decomposition is preferable for this purpose, as it is provably compatible with the Painter's Algorithm for efficient and GPU-friendly rendering. Our experiments show that for real-world scenes, our method provides up to 3x more efficient inference than NeRF (with the same rendering quality), or an improvement of up to 1.0 dB in PSNR (for the same inference cost).


page 1

page 3

page 4

page 7

page 8

page 14


Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Rendering

We present Tensor4D, an efficient yet effective approach to dynamic scen...

NeRD: Neural Reflectance Decomposition from Image Collections

Decomposing a scene into its shape, reflectance, and illumination is a c...

NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fields

Visually exploring in a real-world 4D spatiotemporal space freely in VR ...

Unsupervised Discovery of Object Radiance Fields

We study the problem of inferring an object-centric scene representation...

Multiscale Tensor Decomposition and Rendering Equation Encoding for View Synthesis

Rendering novel views from captured multi-view images has made considera...

Block-NeRF: Scalable Large Scene Neural View Synthesis

We present Block-NeRF, a variant of Neural Radiance Fields that can repr...

Please sign up or login with your details

Forgot password? Click here to reset