Time-lapse image classification using a diffractive neural network

by   Md Sadman Sakib Rahman, et al.

Diffractive deep neural networks (D2NNs) define an all-optical computing framework comprised of spatially engineered passive surfaces that collectively process optical input information by modulating the amplitude and/or the phase of the propagating light. Diffractive optical networks complete their computational tasks at the speed of light propagation through a thin diffractive volume, without any external computing power while exploiting the massive parallelism of optics. Diffractive networks were demonstrated to achieve all-optical classification of objects and perform universal linear transformations. Here we demonstrate, for the first time, a "time-lapse" image classification scheme using a diffractive network, significantly advancing its classification accuracy and generalization performance on complex input objects by using the lateral movements of the input objects and/or the diffractive network, relative to each other. In a different context, such relative movements of the objects and/or the camera are routinely being used for image super-resolution applications; inspired by their success, we designed a time-lapse diffractive network to benefit from the complementary information content created by controlled or random lateral shifts. We numerically explored the design space and performance limits of time-lapse diffractive networks, revealing a blind testing accuracy of 62.03 objects from the CIFAR-10 dataset. This constitutes the highest inference accuracy achieved so far using a single diffractive network on the CIFAR-10 dataset. Time-lapse diffractive networks will be broadly useful for the spatio-temporal analysis of input signals using all-optical processors.


page 12

page 14

page 16


Ensemble learning of diffractive optical networks

A plethora of research advances have emerged in the fields of optics and...

All-optical image classification through unknown random diffusers using a single-pixel diffractive network

Classification of an object behind a random and unknown scattering mediu...

Scale-, shift- and rotation-invariant diffractive optical networks

Recent research efforts in optical computing have gravitated towards dev...

Classification and reconstruction of spatially overlapping phase images using diffractive optical networks

Diffractive optical networks unify wave optics and deep learning to all-...

Analysis of Diffractive Optical Neural Networks and Their Integration with Electronic Neural Networks

Optical machine learning offers advantages in terms of power efficiency,...

All-Optical Information Processing Capacity of Diffractive Surfaces

Precise engineering of materials and surfaces has been at the heart of s...

Learning Diffractive Optical Communication Around Arbitrary Opaque Occlusions

Free-space optical systems are emerging for high data rate communication...

Please sign up or login with your details

Forgot password? Click here to reset