Fast Disparity Estimation from a Single Compressed Light Field Measurement

09/22/2022
by   Emmanuel Martinez, et al.
0

The abundant spatial and angular information from light fields has allowed the development of multiple disparity estimation approaches. However, the acquisition of light fields requires high storage and processing cost, limiting the use of this technology in practical applications. To overcome these drawbacks, the compressive sensing (CS) theory has allowed the development of optical architectures to acquire a single coded light field measurement. This measurement is decoded using an optimization algorithm or deep neural network that requires high computational costs. The traditional approach for disparity estimation from compressed light fields requires first recovering the entire light field and then a post-processing step, thus requiring long times. In contrast, this work proposes a fast disparity estimation from a single compressed measurement by omitting the recovery step required in traditional approaches. Specifically, we propose to jointly optimize an optical architecture for acquiring a single coded light field snapshot and a convolutional neural network (CNN) for estimating the disparity maps. Experimentally, the proposed method estimates disparity maps comparable with those obtained from light fields reconstructed using deep learning approaches. Furthermore, the proposed method is 20 times faster in training and inference than the best method that estimates the disparity from reconstructed light fields.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/18/2021

Spectral Reconstruction and Disparity from Spatio-Spectrally Coded Light Fields via Multi-Task Deep Learning

We present a novel method to reconstruct a spectral central view and its...
research
08/11/2020

Fast and Accurate Optical Flow based Depth Map Estimation from Light Fields

Depth map estimation is a crucial task in computer vision, and new appro...
research
01/31/2018

Fast and Accurate Reconstruction of Compressed Color Light Field

Light field photography has been studied thoroughly in recent years. One...
research
01/20/2018

Learning Light Field Reconstruction from a Single Coded Image

Light field imaging is a rich way of representing the 3D world around us...
research
12/26/2018

A Unified Learning Based Framework for Light Field Reconstruction from Coded Projections

Light field presents a rich way to represent the 3D world by capturing t...
research
06/10/2023

Fast light-field 3D microscopy with out-of-distribution detection and adaptation through Conditional Normalizing Flows

Real-time 3D fluorescence microscopy is crucial for the spatiotemporal a...
research
01/19/2023

Regularizing disparity estimation via multi task learning with structured light reconstruction

3D reconstruction is a useful tool for surgical planning and guidance. H...

Please sign up or login with your details

Forgot password? Click here to reset