EPINET: A Fully-Convolutional Neural Network Using Epipolar Geometry for Depth from Light Field Images

04/06/2018
by   Changha Shin, et al.
6

Light field cameras capture both the spatial and the angular properties of light rays in space. Due to its property, one can compute the depth from light fields in uncontrolled lighting environments, which is a big advantage over active sensing devices. Depth computed from light fields can be used for many applications including 3D modelling and refocusing. However, light field images from hand-held cameras have very narrow baselines with noise, making the depth estimation difficult. any approaches have been proposed to overcome these limitations for the light field depth estimation, but there is a clear trade-off between the accuracy and the speed in these methods. In this paper, we introduce a fast and accurate light field depth estimation method based on a fully-convolutional neural network. Our network is designed by considering the light field geometry and we also overcome the lack of training data by proposing light field specific data augmentation methods. We achieved the top rank in the HCI 4D Light Field Benchmark on most metrics, and we also demonstrate the effectiveness of the proposed method on real-world light-field images.

READ FULL TEXT

page 3

page 4

page 5

page 6

page 7

page 8

research
07/04/2017

Spatial and Angular Resolution Enhancement of Light Fields Using Convolutional Neural Networks

Light field imaging extends the traditional photography by capturing bot...
research
07/25/2019

A Compact Light Field Camera for Real-Time Depth Estimation

Depth cameras are utilized in many applications. Recently light field ap...
research
09/19/2019

Learning to Think Outside the Box: Wide-Baseline Light Field Depth Estimation with EPI-Shift

We propose a method for depth estimation from light field data, based on...
research
07/09/2020

EPI-based Oriented Relation Networks for Light Field Depth Estimation

Light fields record not only the spatial information of observed scenes ...
research
05/01/2018

Fast and Efficient Depth Map Estimation from Light Fields

The paper presents an algorithm for depth map estimation from the light ...
research
03/17/2023

Spectrum-inspired Low-light Image Translation for Saliency Detection

Saliency detection methods are central to several real-world application...
research
09/07/2017

Towards high-throughput 3D insect capture for species discovery and diagnostics

Digitisation of natural history collections not only preserves precious ...

Please sign up or login with your details

Forgot password? Click here to reset