On the Importance of Stereo for Accurate Depth Estimation: An Efficient Semi-Supervised Deep Neural Network Approach

03/26/2018
by   Nikolai Smolyanskiy, et al.
0

We revisit the problem of visual depth estimation in the context of autonomous vehicles. Despite the progress on monocular depth estimation in recent years, we show that the gap between monocular and stereo depth accuracy remains large---a particularly relevant result due to the prevalent reliance upon monocular cameras by vehicles that are expected to be self-driving. We argue that the challenges of removing this gap are significant, owing to fundamental limitations of monocular vision. As a result, we focus our efforts on depth estimation by stereo. We propose a novel semi-supervised learning approach to training a deep stereo neural network, along with a novel architecture containing a machine-learned argmax layer and a custom runtime (that will be shared publicly) that enables a smaller version of our stereo DNN to run on an embedded GPU. Competitive results are shown on the KITTI 2015 stereo dataset. We also evaluate the recent progress of stereo algorithms by measuring the impact upon accuracy of various design criteria.

READ FULL TEXT

page 3

page 4

page 7

page 8

research
04/17/2020

DepthNet Nano: A Highly Compact Self-Normalizing Neural Network for Monocular Depth Estimation

Depth estimation is an active area of research in the field of computer ...
research
06/18/2022

Analysis Computational Complexity Reduction of Monocular and Stereo Depth Estimation Techniques

Accurate depth estimation with lowest compute and energy cost is a cruci...
research
05/18/2019

Semi-Supervised Monocular Depth Estimation with Left-Right Consistency Using Deep Neural Network

There has been tremendous research progress in estimating the depth of a...
research
05/18/2022

Learning Monocular Depth Estimation via Selective Distillation of Stereo Knowledge

Monocular depth estimation has been extensively explored based on deep l...
research
04/18/2020

On the Synergies between Machine Learning and Stereo: a Survey

Stereo matching is one of the longest-standing problems in computer visi...
research
08/19/2018

Eliminating the Blind Spot: Adapting 3D Object Detection and Monocular Depth Estimation to 360° Panoramic Imagery

Recent automotive vision work has focused almost exclusively on processi...
research
09/29/2019

SteReFo: Efficient Image Refocusing with Stereo Vision

Whether to attract viewer attention to a particular object, give the imp...

Please sign up or login with your details

Forgot password? Click here to reset