Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields

02/26/2015
by   Fayao Liu, et al.
0

In this article, we tackle the problem of depth estimation from single monocular images. Compared with depth estimation using multiple images such as stereo depth perception, depth from monocular images is much more challenging. Prior work typically focuses on exploiting geometric priors or additional sources of information, most using hand-crafted features. Recently, there is mounting evidence that features from deep convolutional neural networks (CNN) set new records for various vision applications. On the other hand, considering the continuous characteristic of the depth values, depth estimations can be naturally formulated as a continuous conditional random field (CRF) learning problem. Therefore, here we present a deep convolutional neural field model for estimating depths from single monocular images, aiming to jointly explore the capacity of deep CNN and continuous CRF. In particular, we propose a deep structured learning scheme which learns the unary and pairwise potentials of continuous CRF in a unified deep CNN framework. We then further propose an equally effective model based on fully convolutional networks and a novel superpixel pooling method, which is ∼ 10 times faster, to speedup the patch-wise convolutions in the deep model. With this more efficient model, we are able to design deeper networks to pursue better performance. Experiments on both indoor and outdoor scene datasets demonstrate that the proposed method outperforms state-of-the-art depth estimation approaches.

READ FULL TEXT

page 1

page 4

page 7

page 10

page 11

page 12

page 13

research
11/24/2014

Deep Convolutional Neural Fields for Depth Estimation from a Single Image

We consider the problem of depth estimation from a single monocular imag...
research
03/01/2018

Monocular Depth Estimation using Multi-Scale Continuous CRFs as Sequential Deep Networks

Depth cues have been proved very useful in various computer vision and r...
research
01/28/2016

Discriminative Training of Deep Fully-connected Continuous CRF with Task-specific Loss

Recent works on deep conditional random fields (CRF) have set new record...
research
08/12/2017

Face Parsing via a Fully-Convolutional Continuous CRF Neural Network

In this work, we address the face parsing task with a Fully-Convolutiona...
research
03/27/2018

Learning Depth from Single Images with Deep Neural Network Embedding Focal Length

Learning depth from a single image, as an important issue in scene under...
research
04/07/2017

Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation

This paper addresses the problem of depth estimation from a single still...
research
01/13/2018

Size-to-depth: A New Perspective for Single Image Depth Estimation

In this paper we consider the problem of single monocular image depth es...

Please sign up or login with your details

Forgot password? Click here to reset