Machine Vision using Diffractive Spectral Encoding

by   Jingxi Li, et al.

Machine vision systems mostly rely on lens-based optical imaging architectures that relay the spatial information of objects onto high pixel-count opto-electronic sensor arrays, followed by digital processing of this information. Here, we demonstrate an optical machine vision system that uses trainable matter in the form of diffractive layers to transform and encode the spatial information of objects into the power spectrum of the diffracted light, which is used to perform optical classification of objects with a single-pixel spectroscopic detector. Using a time-domain spectroscopy setup with a plasmonic nanoantenna-based detector, we experimentally validated this framework at terahertz spectrum to optically classify the images of handwritten digits by detecting the spectral power of the diffracted light at ten distinct wavelengths, each representing one class/digit. We also report the coupling of this spectral encoding achieved through a diffractive optical network with a shallow electronic neural network, separately trained to reconstruct the images of handwritten digits based on solely the spectral information encoded in these ten distinct wavelengths within the diffracted light. These reconstructed images demonstrate task-specific image decompression and can also be cycled back as new inputs to the same diffractive network to improve its optical object classification. This unique framework merges the power of deep learning with the spatial and spectral processing capabilities of trainable matter, and can also be extended to other spectral-domain measurement systems to enable new 3D imaging and sensing modalities integrated with spectrally encoded classification tasks performed through diffractive networks.



There are no comments yet.



Classification and reconstruction of spatially overlapping phase images using diffractive optical networks

Diffractive optical networks unify wave optics and deep learning to all-...

All-Optical Machine Learning Using Diffractive Deep Neural Networks

We introduce an all-optical Diffractive Deep Neural Network (D2NN) archi...

An optical biomimetic eyes with interested object imaging

We presented an optical system to perform imaging interested objects in ...

Design of Task-Specific Optical Systems Using Broadband Diffractive Neural Networks

We report a broadband diffractive optical neural network design that sim...

Small-brain neural networks rapidly solve inverse problems with vortex Fourier encoders

We introduce a vortex phase transform with a lenslet-array to accompany ...

Machine Learning-Based Optimization of Chiral Photonic Nanostructures: Evolution- and Neural Network-Based Design

Chiral photonics opens new pathways to manipulate light-matter interacti...

Terahertz Pulse Shaping Using Diffractive Legos

Recent advances in deep learning have been providing non-intuitive solut...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.