DeepAI AI Chat
Log In Sign Up

Physics-based Shading Reconstruction for Intrinsic Image Decomposition

09/03/2020
by   Anil S. Baslamisli, et al.
University of Amsterdam
13

We investigate the use of photometric invariance and deep learning to compute intrinsic images (albedo and shading). We propose albedo and shading gradient descriptors which are derived from physics-based models. Using the descriptors, albedo transitions are masked out and an initial sparse shading map is calculated directly from the corresponding RGB image gradients in a learning-free unsupervised manner. Then, an optimization method is proposed to reconstruct the full dense shading map. Finally, we integrate the generated shading map into a novel deep learning framework to refine it and also to predict corresponding albedo image to achieve intrinsic image decomposition. By doing so, we are the first to directly address the texture and intensity ambiguity problems of the shading estimations. Large scale experiments show that our approach steered by physics-based invariant descriptors achieve superior results on MIT Intrinsics, NIR-RGB Intrinsics, Multi-Illuminant Intrinsic Images, Spectral Intrinsic Images, As Realistic As Possible, and competitive results on Intrinsic Images in the Wild datasets while achieving state-of-the-art shading estimations.

READ FULL TEXT

page 2

page 4

page 7

page 8

page 9

page 10

page 11

page 12

04/08/2022

Invariant Descriptors for Intrinsic Reflectance Optimization

Intrinsic image decomposition aims to factorize an image into albedo (re...
12/04/2017

CNN based Learning using Reflection and Retinex Models for Intrinsic Image Decomposition

Most of the traditional work on intrinsic image decomposition rely on de...
05/21/2021

An Optical physics inspired CNN approach for intrinsic image decomposition

Intrinsic Image Decomposition is an open problem of generating the const...
03/30/2022

PIE-Net: Photometric Invariant Edge Guided Network for Intrinsic Image Decomposition

Intrinsic image decomposition is the process of recovering the image for...
12/03/2018

Towards Spectral Estimation from a Single RGB Image in the Wild

In contrast to the current literature, we address the problem of estimat...
10/08/2015

Learning Data-driven Reflectance Priors for Intrinsic Image Decomposition

We propose a data-driven approach for intrinsic image decomposition, whi...
08/07/2019

Location Field Descriptors: Single Image 3D Model Retrieval in the Wild

We present Location Field Descriptors, a novel approach for single image...