Deep Multi-view Depth Estimation with Predicted Uncertainty

11/19/2020
by   Tong Ke, et al.
6

In this paper, we address the problem of estimating dense depth from a sequence of images using deep neural networks. Specifically, we employ a dense-optical-flow network to compute correspondences and then triangulate the point cloud to obtain an initial depth map. Parts of the point cloud, however, may be less accurate than others due to lack of common observations or small baseline-to-depth ratio. To further increase the triangulation accuracy, we introduce a depth-refinement network (DRN) that optimizes the initial depth map based on the image's contextual cues. In particular, the DRN contains an iterative refinement module (IRM) that improves the depth accuracy over iterations by refining the deep features. Lastly, the DRN also predicts the uncertainty in the refined depths, which is desirable in applications such as measurement selection for scene reconstruction. We show experimentally that our algorithm outperforms state-of-the-art approaches in terms of depth accuracy, and verify that our predicted uncertainty is highly correlated to the actual depth error.

READ FULL TEXT

page 2

page 3

page 5

page 6

research
02/01/2023

Uncertainty-Driven Dense Two-View Structure from Motion

This work introduces an effective and practical solution to the dense tw...
research
04/01/2021

Deep Two-View Structure-from-Motion Revisited

Two-view structure-from-motion (SfM) is the cornerstone of 3D reconstruc...
research
11/24/2022

SfM-TTR: Using Structure from Motion for Test-Time Refinement of Single-View Depth Networks

Estimating a dense depth map from a single view is geometrically ill-pos...
research
12/01/2021

3DVNet: Multi-View Depth Prediction and Volumetric Refinement

We present 3DVNet, a novel multi-view stereo (MVS) depth-prediction meth...
research
05/05/2022

Exploiting Correspondences with All-pairs Correlations for Multi-view Depth Estimation

Multi-view depth estimation plays a critical role in reconstructing and ...
research
04/20/2016

Symmetry-aware Depth Estimation using Deep Neural Networks

Due to the abundance of 2D product images from the Internet, developing ...
research
12/12/2019

Inferring Distributions Over Depth from a Single Image

When building a geometric scene understanding system for autonomous vehi...

Please sign up or login with your details

Forgot password? Click here to reset