Deep Shading: Convolutional Neural Networks for Screen-Space Shading

03/19/2016
by   Oliver Nalbach, et al.
0

In computer vision, convolutional neural networks (CNNs) have recently achieved new levels of performance for several inverse problems where RGB pixel appearance is mapped to attributes such as positions, normals or reflectance. In computer graphics, screen-space shading has recently increased the visual quality in interactive image synthesis, where per-pixel attributes such as positions, normals or reflectance of a virtual 3D scene are converted into RGB pixel appearance, enabling effects like ambient occlusion, indirect light, scattering, depth-of-field, motion blur, or anti-aliasing. In this paper we consider the diagonal problem: synthesizing appearance from given per-pixel attributes using a CNN. The resulting Deep Shading simulates various screen-space effects at competitive quality and speed while not being programmed by human experts but learned from example images.

READ FULL TEXT

page 1

page 4

page 6

page 8

page 9

page 10

research
04/08/2016

Infrared Colorization Using Deep Convolutional Neural Networks

This paper proposes a method for transferring the RGB color spectrum to ...
research
12/10/2018

3D Scene Parsing via Class-Wise Adaptation

We propose the method that uses only computer graphics datasets to parse...
research
12/20/2016

Deep Motion Features for Visual Tracking

Robust visual tracking is a challenging computer vision problem, with ma...
research
04/04/2017

Deep Depth From Focus

Depth from Focus (DFF) is one of the classical ill-posed inverse problem...
research
09/30/2018

Posture recognition using an RGB-D camera : exploring 3D body modeling and deep learning approaches

The emergence of RGB-D sensors offered new possibilities for addressing ...
research
12/22/2014

Occlusion Edge Detection in RGB-D Frames using Deep Convolutional Networks

Occlusion edges in images which correspond to range discontinuity in the...
research
08/07/2019

Relighting Humans: Occlusion-Aware Inverse Rendering for Full-Body Human Images

Relighting of human images has various applications in image synthesis. ...

Please sign up or login with your details

Forgot password? Click here to reset