TiDy-PSFs: Computational Imaging with Time-Averaged Dynamic Point-Spread-Functions

03/30/2023
by   Sachin Shah, et al.
0

Point-spread-function (PSF) engineering is a powerful computational imaging techniques wherein a custom phase mask is integrated into an optical system to encode additional information into captured images. Used in combination with deep learning, such systems now offer state-of-the-art performance at monocular depth estimation, extended depth-of-field imaging, lensless imaging, and other tasks. Inspired by recent advances in spatial light modulator (SLM) technology, this paper answers a natural question: Can one encode additional information and achieve superior performance by changing a phase mask dynamically over time? We first prove that the set of PSFs described by static phase masks is non-convex and that, as a result, time-averaged PSFs generated by dynamic phase masks are fundamentally more expressive. We then demonstrate, in simulation, that time-averaged dynamic (TiDy) phase masks can offer substantially improved monocular depth estimation and extended depth-of-field imaging performance.

READ FULL TEXT

page 1

page 5

page 6

page 7

research
04/14/2022

End-to-end Learning for Joint Depth and Image Reconstruction from Diffracted Rotation

Monocular depth estimation is still an open challenge due to the ill-pos...
research
07/03/2022

PS^2F: Polarized Spiral Point Spread Function for Single-Shot 3D Sensing

We propose a compact snapshot monocular depth estimation technique that ...
research
04/09/2021

CodedStereo: Learned Phase Masks for Large Depth-of-field Stereo

Conventional stereo suffers from a fundamental trade-off between imaging...
research
08/03/2016

FPGA system for real-time computational extended depth of field imaging using phase aperture coding

We present a proof-of-concept end-to-end system for computational extend...
research
08/18/2021

A Simple Framework for 3D Lensless Imaging with Programmable Masks

Lensless cameras provide a framework to build thin imaging systems by re...
research
03/30/2021

Mask-ToF: Learning Microlens Masks for Flying Pixel Correction in Time-of-Flight Imaging

We introduce Mask-ToF, a method to reduce flying pixels (FP) in time-of-...
research
12/31/2019

Learning Wavefront Coding for Extended Depth of Field Imaging

The depth of field constitutes an important quality factor of imaging sy...

Please sign up or login with your details

Forgot password? Click here to reset