Ensemble learning of diffractive optical networks

09/15/2020
by   Md Sadman Sakib Rahman, et al.
0

A plethora of research advances have emerged in the fields of optics and photonics that benefit from harnessing the power of machine learning. Specifically, there has been a revival of interest in optical computing hardware, due to its potential advantages for machine learning tasks in terms of parallelization, power efficiency and computation speed. Diffractive Deep Neural Networks (D2NNs) form such an optical computing framework, which benefits from deep learning-based design of successive diffractive layers to all-optically process information as the input light diffracts through these passive layers. D2NNs have demonstrated success in various tasks, including e.g., object classification, spectral-encoding of information, optical pulse shaping and imaging, among others. Here, we significantly improve the inference performance of diffractive optical networks using feature engineering and ensemble learning. After independently training a total of 1252 D2NNs that were diversely engineered with a variety of passive input filters, we applied a pruning algorithm to select an optimized ensemble of D2NNs that collectively improve their image classification accuracy. Through this pruning, we numerically demonstrated that ensembles of N=14 and N=30 D2NNs achieve blind testing accuracies of 61.14 CIFAR-10 test images, providing an inference improvement of >16 the average performance of the individual D2NNs within each ensemble. These results constitute the highest inference accuracies achieved to date by any diffractive optical neural network design on the same dataset and might provide a significant leapfrog to extend the application space of diffractive optical image classification and machine vision systems.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 17

page 19

page 21

page 22

06/08/2019

Class-specific Differential Detection in Diffractive Optical Neural Networks Improves Inference Accuracy

Diffractive deep neural networks have been introduced earlier as an opti...
02/27/2017

Fast and Accurate Inference with Adaptive Ensemble Prediction in Image Classification with Deep Neural Networks

Ensembling multiple predictions is a widely used technique to improve th...
06/30/2020

Terahertz Pulse Shaping Using Diffractive Legos

Recent advances in deep learning have been providing non-intuitive solut...
10/03/2018

Analysis of Diffractive Optical Neural Networks and Their Integration with Electronic Neural Networks

Optical machine learning offers advantages in terms of power efficiency,...
10/24/2020

Scale-, shift- and rotation-invariant diffractive optical networks

Recent research efforts in optical computing have gravitated towards dev...
07/25/2020

All-Optical Information Processing Capacity of Diffractive Surfaces

Precise engineering of materials and surfaces has been at the heart of s...
11/02/2021

Cascadable all-optical NAND gates using diffractive networks

Owing to its potential advantages such as scalability, low latency and p...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.