Fast and Accurate Optical Flow based Depth Map Estimation from Light Fields

08/11/2020
by   Yang Chen, et al.
1

Depth map estimation is a crucial task in computer vision, and new approaches have recently emerged taking advantage of light fields, as this new imaging modality captures much more information about the angular direction of light rays compared to common approaches based on stereoscopic images or multi-view. In this paper, we propose a novel depth estimation method from light fields based on existing optical flow estimation methods. The optical flow estimator is applied on a sequence of images taken along an angular dimension of the light field, which produces several disparity map estimates. Considering both accuracy and efficiency, we choose the feature flow method as our optical flow estimator. Thanks to its spatio-temporal edge-aware filtering properties, the different disparity map estimates that we obtain are very consistent, which allows a fast and simple aggregation step to create a single disparity map, which can then converted into a depth map. Since the disparity map estimates are consistent, we can also create a depth map from each disparity estimate, and then aggregate the different depth maps in the 3D space to create a single dense depth map.

READ FULL TEXT

page 2

page 3

page 5

page 6

page 7

research
10/07/2018

Finding Correspondences for Optical Flow and Disparity Estimations using a Sub-pixel Convolution-based Encoder-Decoder Network

Deep convolutional neural networks (DCNN) have recently shown promising ...
research
01/20/2023

Unsupervised Light Field Depth Estimation via Multi-view Feature Matching with Occlusion Prediction

Depth estimation from light field (LF) images is a fundamental step for ...
research
09/22/2022

Fast Disparity Estimation from a Single Compressed Light Field Measurement

The abundant spatial and angular information from light fields has allow...
research
07/09/2020

EPI-based Oriented Relation Networks for Light Field Depth Estimation

Light fields record not only the spatial information of observed scenes ...
research
09/06/2016

Depth Estimation Through a Generative Model of Light Field Synthesis

Light field photography captures rich structural information that may fa...
research
07/07/2021

Edge-aware Bidirectional Diffusion for Dense Depth Estimation from Light Fields

We present an algorithm to estimate fast and accurate depth maps from li...
research
05/01/2018

Fast and Efficient Depth Map Estimation from Light Fields

The paper presents an algorithm for depth map estimation from the light ...

Please sign up or login with your details

Forgot password? Click here to reset