IntrinSeqNet: Learning to Estimate the Reflectance from Varying Illumination

06/13/2019
by   Grégoire Nieto, et al.
1

Intrinsic image decomposition describes an image based on its reflectance and shading components. In this paper we tackle the problem of estimating the diffuse reflectance from a sequence of images captured from a fixed viewpoint under various illuminations. To this end we propose a deep learning approach to avoid heuristics and strong assumptions on the reflectance prior. We compare two network architectures: one classic 'U' shaped Convolutional Neural Network (CNN) and a Recurrent Neural Network (RNN) composed of Convolutional Gated Recurrent Units (CGRU). We train our networks on a new dataset specifically designed for the task of intrinsic decomposition from sequences. We test our networks on MIT and BigTime datasets and outperform state-of-the-art algorithms both qualitatively and quantitatively.

READ FULL TEXT

page 1

page 2

page 5

page 6

page 7

page 8

research
12/23/2016

DARN: a Deep Adversial Residual Network for Intrinsic Image Decomposition

We present a new deep supervised learning method for intrinsic decomposi...
research
04/14/2015

Learning to Compare Image Patches via Convolutional Neural Networks

In this paper we show how to learn directly from image data (i.e., witho...
research
12/08/2015

Direct Intrinsics: Learning Albedo-Shading Decomposition by Convolutional Regression

We introduce a new approach to intrinsic image decomposition, the task o...
research
07/29/2018

Convolutional Gated Recurrent Units for Medical Relation Classification

Convolutional neural network (CNN) and recurrent neural network (RNN) mo...
research
03/26/2018

Predicting the Future with Transformational States

An intelligent observer looks at the world and sees not only what is, bu...
research
07/30/2018

Deep Hybrid Real and Synthetic Training for Intrinsic Decomposition

Intrinsic image decomposition is the process of separating the reflectan...
research
05/25/2018

Intrinsic Image Transformation via Scale Space Decomposition

We introduce a new network structure for decomposing an image into its i...

Please sign up or login with your details

Forgot password? Click here to reset