Unified Depth Prediction and Intrinsic Image Decomposition from a Single Image via Joint Convolutional Neural Fields

03/21/2016
by   Seungryong Kim, et al.
0

We present a method for jointly predicting a depth map and intrinsic images from single-image input. The two tasks are formulated in a synergistic manner through a joint conditional random field (CRF) that is solved using a novel convolutional neural network (CNN) architecture, called the joint convolutional neural field (JCNF) model. Tailored to our joint estimation problem, JCNF differs from previous CNNs in its sharing of convolutional activations and layers between networks for each task, its inference in the gradient domain where there exists greater correlation between depth and intrinsic images, and the incorporation of a gradient scale network that learns the confidence of estimated gradients in order to effectively balance them in the solution. This approach is shown to surpass state-of-the-art methods both on single-image depth estimation and on intrinsic image decomposition.

READ FULL TEXT

page 4

page 11

page 13

page 15

research
11/24/2014

Deep Convolutional Neural Fields for Depth Estimation from a Single Image

We consider the problem of depth estimation from a single monocular imag...
research
03/12/2021

Dilated Fully Convolutional Neural Network for Depth Estimation from a Single Image

Depth prediction plays a key role in understanding a 3D scene. Several t...
research
10/30/2017

Deep Learning and Conditional Random Fields-based Depth Estimation and Topographical Reconstruction from Conventional Endoscopy

Colorectal cancer is the fourth leading cause of cancer deaths worldwide...
research
01/15/2020

Single Image Dehazing Using Ranking Convolutional Neural Network

Single image dehazing, which aims to recover the clear image solely from...
research
08/15/2016

Intrinsic Light Field Images

We present a method to automatically decompose a light field into its in...
research
06/01/2023

StyleGAN knows Normal, Depth, Albedo, and More

Intrinsic images, in the original sense, are image-like maps of scene pr...
research
04/30/2019

Structured Prediction using cGANs with Fusion Discriminator

We propose the fusion discriminator, a single unified framework for inco...

Please sign up or login with your details

Forgot password? Click here to reset