Classification and reconstruction of spatially overlapping phase images using diffractive optical networks

08/18/2021
by   Deniz Mengu, et al.
11

Diffractive optical networks unify wave optics and deep learning to all-optically compute a given machine learning or computational imaging task as the light propagates from the input to the output plane. Here, we report the design of diffractive optical networks for the classification and reconstruction of spatially overlapping, phase-encoded objects. When two different phase-only objects spatially overlap, the individual object functions are perturbed since their phase patterns are summed up. The retrieval of the underlying phase images from solely the overlapping phase distribution presents a challenging problem, the solution of which is generally not unique. We show that through a task-specific training process, passive diffractive networks composed of successive transmissive layers can all-optically and simultaneously classify two different randomly-selected, spatially overlapping phase images at the input. After trained with  550 million unique combinations of phase-encoded handwritten digits from the MNIST dataset, our blind testing results reveal that the diffractive network achieves an accuracy of >85.8 classification of two overlapping phase images of new handwritten digits. In addition to all-optical classification of overlapping phase objects, we also demonstrate the reconstruction of these phase images based on a shallow electronic neural network that uses the highly compressed output of the diffractive network as its input (with e.g.,  20-65 times less number of pixels) to rapidly reconstruct both of the phase images, despite their spatial overlap and related phase ambiguity. The presented phase image classification and reconstruction framework might find applications in e.g., computational imaging, microscopy and quantitative phase imaging fields.

READ FULL TEXT

page 22

page 23

page 24

page 25

page 26

page 27

page 28

research
08/08/2022

All-optical image classification through unknown random diffusers using a single-pixel diffractive network

Classification of an object behind a random and unknown scattering mediu...
research
05/15/2020

Machine Vision using Diffractive Spectral Encoding

Machine vision systems mostly rely on lens-based optical imaging archite...
research
01/22/2022

Diffractive all-optical computing for quantitative phase imaging

Quantitative phase imaging (QPI) is a label-free computational imaging t...
research
08/05/2023

Multispectral Quantitative Phase Imaging Using a Diffractive Optical Network

As a label-free imaging technique, quantitative phase imaging (QPI) prov...
research
02/21/2019

A Parallel Optical Image Security System with Cascaded Phase-only Masks

In many previous works, a cascaded phase-only mask (or phase-only hologr...
research
03/23/2022

Hyper-Spectral Imaging for Overlapping Plastic Flakes Segmentation

Given the hyper-spectral imaging unique potentials in grasping the polym...
research
08/23/2022

Time-lapse image classification using a diffractive neural network

Diffractive deep neural networks (D2NNs) define an all-optical computing...

Please sign up or login with your details

Forgot password? Click here to reset