Deep Illumination: Approximating Dynamic Global Illumination with Generative Adversarial Network

10/26/2017
by   Manu Mathew Thomas, et al.
0

We present Deep Illumination, a novel machine learning technique for approximating global illumination (GI) in real-time applications using a Conditional Generative Adversarial Network. Our primary focus is on generating indirect illumination and soft shadows with offline rendering quality at interactive rates. Inspired from recent advancement in image-to-image translation problems using deep generative convolutional networks, we introduce a variant of this network that learns a mapping from Gbuffers (depth map, normal map, and diffuse map) and direct illumination to any global illumination solution. Our primary contribution is showing that a generative model can be used to learn a density estimation from screen space buffers to an advanced illumination model for a 3D environment. Once trained, our network can approximate global illumination for scene configurations it has never encountered before within the environment it was trained on. We evaluate Deep Illumination through a comparison with both a state of the art real-time GI technique (VXGI) and an offline rendering GI technique (path tracing). We show that our method produces effective GI approximations and is also computationally cheaper than existing GI techniques. Our technique has the potential to replace existing precomputed and screen-space techniques for producing global illumination effects in dynamic scenes with physically-based rendering quality.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 8

research
02/13/2023

Fast Real-Time Shading for Polygonal Hair

Though a lot of improvement has been made to hair rendering techniques i...
research
10/06/2019

One Shot Radiance: Global Illumination Using Convolutional Autoencoders

Rendering realistic images with Global Illumination (GI) is a computatio...
research
06/11/2019

Multi-Resolution Rendering for Computationally Expensive Lighting Effects

Many lighting methods used in computer graphics such as indirect illumin...
research
04/01/2021

Real-Time Global Illumination Using OpenGL And Voxel Cone Tracing

Building systems capable of replicating global illumination models with ...
research
11/08/2005

Spatiotemporal sensistivity and visual attention for efficient rendering of dynamic environments

We present a method to accelerate global illumination computation in dyn...
research
06/05/2020

Learning Neural Light Transport

In recent years, deep generative models have gained significance due to ...
research
03/10/2021

A Distributed, Decoupled System for Losslessly Streaming Dynamic Light Probes to Thin Clients

We present a networked, high performance graphics system that combines d...

Please sign up or login with your details

Forgot password? Click here to reset