TermiNeRF: Ray Termination Prediction for Efficient Neural Rendering

11/05/2021
by   Martin Piala, et al.
16

Volume rendering using neural fields has shown great promise in capturing and synthesizing novel views of 3D scenes. However, this type of approach requires querying the volume network at multiple points along each viewing ray in order to render an image, resulting in very slow rendering times. In this paper, we present a method that overcomes this limitation by learning a direct mapping from camera rays to locations along the ray that are most likely to influence the pixel's final appearance. Using this approach we are able to render, train and fine-tune a volumetrically-rendered neural field model an order of magnitude faster than standard approaches. Unlike existing methods, our approach works with general volumes and can be trained end-to-end.

READ FULL TEXT

page 1

page 2

page 5

page 6

page 7

page 8

research
02/25/2021

IBRNet: Learning Multi-View Image-Based Rendering

We present a method that synthesizes novel views of complex scenes by in...
research
10/13/2017

Single-image Tomography: 3D Volumes from 2D X-Rays

As many different 3D volumes could produce the same 2D x-ray image, inve...
research
03/18/2021

FastNeRF: High-Fidelity Neural Rendering at 200FPS

Recent work on Neural Radiance Fields (NeRF) showed how neural networks ...
research
02/21/2023

Differentiable Rendering with Reparameterized Volume Sampling

In view synthesis, a neural radiance field approximates underlying densi...
research
07/26/2021

Constraining dark matter annihilation with cosmic ray antiprotons using neural networks

The interpretation of data from indirect detection experiments searching...
research
10/25/2021

Learning Neural Transmittance for Efficient Rendering of Reflectance Fields

Recently neural volumetric representations such as neural reflectance fi...
research
03/24/2021

Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields

The rendering procedure used by neural radiance fields (NeRF) samples a ...

Please sign up or login with your details

Forgot password? Click here to reset