DeepAI
Log In Sign Up

KiloNeuS: Implicit Neural Representations with Real-Time Global Illumination

06/22/2022
by   Stefano Esposito, et al.
0

The latest trends in inverse rendering techniques for reconstruction use neural networks to learn 3D representations as neural fields. NeRF-based techniques fit multi-layer perceptrons (MLPs) to a set of training images to estimate a radiance field which can then be rendered from any virtual camera by means of volume rendering algorithms. Major drawbacks of these representations are the lack of well-defined surfaces and non-interactive rendering times, as wide and deep MLPs must be queried millions of times per single frame. These limitations have recently been singularly overcome, but managing to accomplish this simultaneously opens up new use cases. We present KiloNeuS, a new neural object representation that can be rendered in path-traced scenes at interactive frame rates. KiloNeuS enables the simulation of realistic light interactions between neural and classic primitives in shared scenes, and it demonstrably performs in real-time with plenty of room for future optimizations and extensions.

READ FULL TEXT

page 1

page 2

page 5

03/21/2022

NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction

While NeRF has shown great success for neural reconstruction and renderi...
06/04/2021

Light Field Networks: Neural Scene Representations with Single-Evaluation Rendering

Inferring representations of 3D scenes from 2D observations is a fundame...
02/28/2022

Neural Adaptive SCEne Tracing

Neural rendering with implicit neural networks has recently emerged as a...
07/28/2020

Signed Distance Fields Dynamic Diffuse Global Illumination

Global Illumination (GI) is of utmost importance in the field of photo-r...
01/27/2023

A Comparison of Tiny-nerf versus Spatial Representations for 3d Reconstruction

Neural rendering has emerged as a powerful paradigm for synthesizing ima...
11/07/2022

QRF: Implicit Neural Representations with Quantum Radiance Fields

Photorealistic rendering of real-world scenes is a tremendous challenge ...
04/17/2019

Rendering of Complex Heterogenous Scenes using Progressive Blue Surfels

We present a technique for rendering highly complex 3D scenes in real-ti...