Joint Image and Depth Estimation with Mask-Based Lensless Cameras

10/06/2019
by   Yucheng Zheng, et al.
16

Mask-based lensless cameras replace the lens of a conventional camera with a customized mask. These cameras can potentially be very thin and even flexible. Recently, it has been demonstrated that such mask-based cameras can recover light intensity and depth information of a scene. Existing depth recovery algorithms either assume that the scene consists of a small number of depth planes or solve a sparse recovery problem over a large 3D volume. Both these approaches fail to recover scene with large depth variations. In this paper, we propose a new approach for depth estimation based on alternating gradient descent algorithm that jointly estimates a continuous depth map and light distribution of the unknown scene from its lensless measurements. The computational complexity of the algorithm scales linearly with the spatial dimension of the imaging system. We present simulation results on image and depth reconstruction for a variety of 3D test scenes. A comparison between the proposed algorithm and other method shows that our algorithm is faster and more robust for natural scenes with a large range of depths.

READ FULL TEXT

page 6

page 7

page 8

page 10

page 11

page 12

research
08/18/2021

A Simple Framework for 3D Lensless Imaging with Programmable Masks

Lensless cameras provide a framework to build thin imaging systems by re...
research
11/09/2017

Toward Depth Estimation Using Mask-Based Lensless Cameras

Recently, coded masks have been used to demonstrate a thin form-factor l...
research
08/01/2019

Physical Cue based Depth-Sensing by Color Coding with Deaberration Network

Color-coded aperture (CCA) methods can physically measure the depth of a...
research
11/21/2017

Total Variation-Based Dense Depth from Multi-Camera Array

Multi-Camera arrays are increasingly employed in both consumer and indus...
research
11/25/2021

Coded Illumination for Improved Lensless Imaging

Mask-based lensless cameras can be flat, thin and light-weight, which ma...
research
06/03/2021

Towards urban scenes understanding through polarization cues

Autonomous robotics is critically affected by the robustness of its scen...
research
06/15/2015

Automatic Layer Separation using Light Field Imaging

We propose a novel approach that jointly removes reflection or transluce...

Please sign up or login with your details

Forgot password? Click here to reset