Spatially Varying Nanophotonic Neural Networks

08/07/2023
by   Kaixuan Wei, et al.
0

The explosive growth of computation and energy cost of artificial intelligence has spurred strong interests in new computing modalities as potential alternatives to conventional electronic processors. Photonic processors that execute operations using photons instead of electrons, have promised to enable optical neural networks with ultra-low latency and power consumption. However, existing optical neural networks, limited by the underlying network designs, have achieved image recognition accuracy much lower than state-of-the-art electronic neural networks. In this work, we close this gap by introducing a large-kernel spatially-varying convolutional neural network learned via low-dimensional reparameterization techniques. We experimentally instantiate the network with a flat meta-optical system that encompasses an array of nanophotonic structures designed to induce angle-dependent responses. Combined with an extremely lightweight electronic backend with approximately 2K parameters we demonstrate a nanophotonic neural network reaches 73.80% blind test classification accuracy on CIFAR-10 dataset, and, as such, the first time, an optical neural network outperforms the first modern digital neural network – AlexNet (72.64%) with 57M parameters, bringing optical neural network into modern deep learning era.

READ FULL TEXT

page 1

page 12

page 13

page 14

page 15

page 16

research
04/27/2021

An optical neural network using less than 1 photon per multiplication

Deep learning has rapidly become a widespread tool in both scientific an...
research
07/21/2023

Digital Modeling on Large Kernel Metamaterial Neural Network

Deep neural networks (DNNs) utilized recently are physically deployed wi...
research
12/20/2022

Sophisticated deep learning with on-chip optical diffractive tensor processing

The ever-growing deep learning technologies are making revolutionary cha...
research
11/04/2022

DAD vision: opto-electronic co-designed computer vision with division adjoint method

The miniaturization and mobility of computer vision systems are limited ...
research
08/19/2022

Nonlinear Optical Data Transformer for Machine Learning

Modern machine learning models use an ever-increasing number of paramete...
research
06/30/2020

Multifunctional Meta-Optic Systems: Inversely Designed with Artificial Intelligence

Flat optics foresees a new era of ultra-compact optical devices, where m...
research
05/16/2018

Optical Neural Networks

We develop a novel optical neural network (ONN) framework which introduc...

Please sign up or login with your details

Forgot password? Click here to reset