DARN: a Deep Adversial Residual Network for Intrinsic Image Decomposition

12/23/2016
by   Louis Lettry, et al.
0

We present a new deep supervised learning method for intrinsic decomposition of a single image into its albedo and shading components. Our contributions are based on a new fully convolutional neural network that estimates absolute albedo and shading jointly. As opposed to classical intrinsic image decomposition work, it is fully data-driven, hence does not require any physical priors like shading smoothness or albedo sparsity, nor does it rely on geometric information such as depth. Compared to recent deep learning techniques, we simplify the architecture, making it easier to build and train. It relies on a single end-to-end deep sequence of residual blocks and a perceptually-motivated metric formed by two discriminator networks. We train and demonstrate our architecture on the publicly available MPI Sintel dataset and its intrinsic image decomposition augmentation. We additionally discuss and augment the set of quantitative metrics so as to account for the more challenging recovery of non scale-invariant quantities. Results show that our work outperforms the state of the art algorithms both on the qualitative and quantitative aspect, while training convergence time is reduced.

READ FULL TEXT

page 1

page 7

page 8

research
12/08/2015

Direct Intrinsics: Learning Albedo-Shading Decomposition by Convolutional Regression

We introduce a new approach to intrinsic image decomposition, the task o...
research
05/25/2018

Intrinsic Image Transformation via Scale Space Decomposition

We introduce a new network structure for decomposing an image into its i...
research
06/13/2019

IntrinSeqNet: Learning to Estimate the Reflectance from Varying Illumination

Intrinsic image decomposition describes an image based on its reflectanc...
research
10/08/2015

Learning Data-driven Reflectance Priors for Intrinsic Image Decomposition

We propose a data-driven approach for intrinsic image decomposition, whi...
research
09/14/2020

Deep intrinsic decomposition trained on surreal scenes yet with realistic light effects

Estimation of intrinsic images still remains a challenging task due to w...
research
05/21/2021

An Optical physics inspired CNN approach for intrinsic image decomposition

Intrinsic Image Decomposition is an open problem of generating the const...
research
03/02/2018

Deep Unsupervised Intrinsic Image Decomposition by Siamese Training

We harness modern intrinsic decomposition tools based on deep learning t...

Please sign up or login with your details

Forgot password? Click here to reset