Analysis of Diffractive Neural Networks for Seeing Through Random Diffusers

05/01/2022
by   Yuhang Li, et al.
10

Imaging through diffusive media is a challenging problem, where the existing solutions heavily rely on digital computers to reconstruct distorted images. We provide a detailed analysis of a computer-free, all-optical imaging method for seeing through random, unknown phase diffusers using diffractive neural networks, covering different deep learning-based training strategies. By analyzing various diffractive networks designed to image through random diffusers with different correlation lengths, a trade-off between the image reconstruction fidelity and distortion reduction capability of the diffractive network was observed. During its training, random diffusers with a range of correlation lengths were used to improve the diffractive network's generalization performance. Increasing the number of random diffusers used in each epoch reduced the overfitting of the diffractive network's imaging performance to known diffusers. We also demonstrated that the use of additional diffractive layers improved the generalization capability to see through new, random diffusers. Finally, we introduced deliberate misalignments in training to 'vaccinate' the network against random layer-to-layer shifts that might arise due to the imperfect assembly of the diffractive networks. These analyses provide a comprehensive guide in designing diffractive networks to see through random diffusers, which might profoundly impact many fields, such as biomedical imaging, atmospheric physics, and autonomous driving.

READ FULL TEXT

page 30

page 31

page 33

page 36

page 37

page 39

page 41

page 42

research
08/08/2022

All-optical image classification through unknown random diffusers using a single-pixel diffractive network

Classification of an object behind a random and unknown scattering mediu...
research
04/22/2022

Fourier Imager Network (FIN): A deep neural network for hologram reconstruction with superior external generalization

Deep learning-based image reconstruction methods have achieved remarkabl...
research
05/10/2017

Phase recovery and holographic image reconstruction using deep learning in neural networks

Phase recovery from intensity-only measurements forms the heart of coher...
research
10/21/2020

Recurrent neural network-based volumetric fluorescence microscopy

Volumetric imaging of samples using fluorescence microscopy plays an imp...
research
05/25/2021

A Geometry-Informed Deep Learning Framework for Ultra-Sparse 3D Tomographic Image Reconstruction

Deep learning affords enormous opportunities to augment the armamentariu...
research
10/18/2022

Intra-Source Style Augmentation for Improved Domain Generalization

The generalization with respect to domain shifts, as they frequently app...
research
02/09/2022

Statistical Tools for Imaging Atmospheric Cherenkov Telescopes

The development of Imaging Atmospheric Cherenkov Telescopes (IACTs) unve...

Please sign up or login with your details

Forgot password? Click here to reset