Scale-, shift- and rotation-invariant diffractive optical networks

10/24/2020
by   Deniz Mengu, et al.
25

Recent research efforts in optical computing have gravitated towards developing optical neural networks that aim to benefit from the processing speed and parallelism of optics/photonics in machine learning applications. Among these endeavors, Diffractive Deep Neural Networks (D2NNs) harness light-matter interaction over a series of trainable surfaces, designed using deep learning, to compute a desired statistical inference task as the light waves propagate from the input plane to the output field-of-view. Although, earlier studies have demonstrated the generalization capability of diffractive optical networks to unseen data, achieving e.g., >98 accuracy for handwritten digits, these previous designs are in general sensitive to the spatial scaling, translation and rotation of the input objects. Here, we demonstrate a new training strategy for diffractive networks that introduces input object translation, rotation and/or scaling during the training phase as uniformly distributed random variables to build resilience in their blind inference performance against such object transformations. This training strategy successfully guides the evolution of the diffractive optical network design towards a solution that is scale-, shift- and rotation-invariant, which is especially important and useful for dynamic machine vision applications in e.g., autonomous cars, in-vivo imaging of biomedical specimen, among others.

READ FULL TEXT

page 22

page 23

page 24

page 26

page 27

page 28

research
05/23/2020

Misalignment Resilient Diffractive Optical Networks

As an optical machine learning framework, Diffractive Deep Neural Networ...
research
08/08/2022

All-optical image classification through unknown random diffusers using a single-pixel diffractive network

Classification of an object behind a random and unknown scattering mediu...
research
08/23/2022

Time-lapse image classification using a diffractive neural network

Diffractive deep neural networks (D2NNs) define an all-optical computing...
research
07/25/2020

All-Optical Information Processing Capacity of Diffractive Surfaces

Precise engineering of materials and surfaces has been at the heart of s...
research
06/08/2019

Class-specific Differential Detection in Diffractive Optical Neural Networks Improves Inference Accuracy

Diffractive deep neural networks have been introduced earlier as an opti...
research
07/01/2020

Deep Neural Networks for Computational Optical Form Measurements

Deep neural networks have been successfully applied in many different fi...
research
11/11/2021

Machine Learning-Based Optimization of Chiral Photonic Nanostructures: Evolution- and Neural Network-Based Design

Chiral photonics opens new pathways to manipulate light-matter interacti...

Please sign up or login with your details

Forgot password? Click here to reset