Depth Map Prediction from a Single Image using a Multi-Scale Deep Network

06/09/2014
by   David Eigen, et al.
0

Predicting depth is an essential component in understanding the 3D geometry of a scene. While for stereo images local correspondence suffices for estimation, finding depth relations from a single image is less straightforward, requiring integration of both global and local information from various cues. Moreover, the task is inherently ambiguous, with a large source of uncertainty coming from the overall scale. In this paper, we present a new method that addresses this task by employing two deep network stacks: one that makes a coarse global prediction based on the entire image, and another that refines this prediction locally. We also apply a scale-invariant error to help measure depth relations rather than scale. By leveraging the raw datasets as large sources of training data, our method achieves state-of-the-art results on both NYU Depth and KITTI, and matches detailed depth boundaries without the need for superpixelation.

READ FULL TEXT

page 4

page 7

page 8

research
04/20/2022

OutCast: Outdoor Single-image Relighting with Cast Shadows

We propose a relighting method for outdoor images. Our method mainly foc...
research
05/23/2016

Depth from a Single Image by Harmonizing Overcomplete Local Network Predictions

A single color image can contain many cues informative towards different...
research
06/08/2018

Deep multi-scale architectures for monocular depth estimation

This paper aims at understanding the role of multi-scale information in ...
research
01/19/2015

Coupled Depth Learning

In this paper we propose a method for estimating depth from a single ima...
research
05/07/2015

Shadow Optimization from Structured Deep Edge Detection

Local structures of shadow boundaries as well as complex interactions of...
research
02/13/2023

VA-DepthNet: A Variational Approach to Single Image Depth Prediction

We introduce VA-DepthNet, a simple, effective, and accurate deep neural ...
research
07/25/2017

Relative Depth Order Estimation Using Multi-scale Densely Connected Convolutional Networks

We study the problem of estimating the relative depth order of point pai...

Please sign up or login with your details

Forgot password? Click here to reset