MVDepthNet: Real-time Multiview Depth Estimation Neural Network

07/23/2018
by   Kaixuan Wang, et al.
10

Although deep neural networks have been widely applied to computer vision problems, extending them into multiview depth estimation is non-trivial. In this paper, we present MVDepthNet, a convolutional network to solve the depth estimation problem given several image-pose pairs from a localized monocular camera in neighbor viewpoints. Multiview observations are encoded in a cost volume and then combined with the reference image to estimate the depth map using an encoder-decoder network. By encoding the information from multiview observations into the cost volume, our method achieves real-time performance and the flexibility of traditional methods that can be applied regardless of the camera intrinsic parameters and the number of images. Geometric data augmentation is used to train MVDepthNet. We further apply MVDepthNet in a monocular dense mapping system that continuously estimates depth maps using a single localized moving camera. Experiments show that our method can generate depth maps efficiently and precisely.

READ FULL TEXT

page 1

page 7

page 13

page 14

page 15

page 16

page 17

page 18

research
03/14/2020

Monocular Depth Estimation Based On Deep Learning: An Overview

Depth information is important for autonomous systems to perceive enviro...
research
05/16/2019

How do neural networks see depth in single images?

Deep neural networks have lead to a breakthrough in depth estimation fro...
research
11/20/2020

MobileDepth: Efficient Monocular Depth Prediction on Mobile Devices

Depth prediction is fundamental for many useful applications on computer...
research
09/06/2022

Crowdsourced-based Deep Convolutional Networks for Urban Flood Depth Mapping

Successful flood recovery and evacuation require access to reliable floo...
research
10/17/2016

Parse Geometry from a Line: Monocular Depth Estimation with Partial Laser Observation

Many standard robotic platforms are equipped with at least a fixed 2D la...
research
08/06/2018

DeepTAM: Deep Tracking and Mapping

We present a system for keyframe-based dense camera tracking and depth m...
research
11/26/2010

Formulation Of A N-Degree Polynomial For Depth Estimation using a Single Image

The depth of a visible surface of a scene is the distance between the su...

Please sign up or login with your details

Forgot password? Click here to reset