An optical neural network using less than 1 photon per multiplication

04/27/2021
by   Tianyu Wang, et al.
22

Deep learning has rapidly become a widespread tool in both scientific and commercial endeavors. Milestones of deep learning exceeding human performance have been achieved for a growing number of tasks over the past several years, across areas as diverse as game-playing, natural-language translation, and medical-image analysis. However, continued progress is increasingly hampered by the high energy costs associated with training and running deep neural networks on electronic processors. Optical neural networks have attracted attention as an alternative physical platform for deep learning, as it has been theoretically predicted that they can fundamentally achieve higher energy efficiency than neural networks deployed on conventional digital computers. Here, we experimentally demonstrate an optical neural network achieving 99 accuracy on handwritten-digit classification using  3.2 detected photons per weight multiplication and  90 10^-19J of optical energy) per weight multiplication. This performance was achieved using a custom free-space optical processor that executes matrix-vector multiplications in a massively parallel fashion, with up to  0.5 million scalar (weight) multiplications performed at the same time. Using commercially available optical components and standard neural-network training methods, we demonstrated that optical neural networks can operate near the standard quantum limit with extremely low optical powers and still achieve high accuracy. Our results provide a proof-of-principle for low-optical-power operation, and with careful system design including the surrounding electronics used for data storage and control, open up a path to realizing optical processors that require only10^-16J total energy per scalar multiplication – which is orders of magnitude more efficient than current digital processors.

READ FULL TEXT

page 17

page 18

page 19

page 24

page 25

page 26

page 33

page 37

research
02/20/2023

Optical Transformers

The rapidly increasing size of deep-learning models has caused renewed a...
research
08/07/2023

Spatially Varying Nanophotonic Neural Networks

The explosive growth of computation and energy cost of artificial intell...
research
07/28/2023

Quantum-noise-limited optical neural networks operating at a few quanta per activation

Analog physical neural networks, which hold promise for improved energy ...
research
05/16/2018

Optical Neural Networks

We develop a novel optical neural network (ONN) framework which introduc...
research
07/31/2023

The physics of optical computing

There has been a resurgence of interest in optical computing over the pa...
research
07/27/2022

Image sensing with multilayer, nonlinear optical neural networks

Optical imaging is commonly used for both scientific and technological a...
research
05/27/2021

Avancee-1 Mission and SaDoD Method: LiDAR-based stimulated atomic disintegration of space debris (SaDoD) using Optical Neural Networks

The surface degradation of satellites in Low Earth Orbit (LEO) is affect...

Please sign up or login with your details

Forgot password? Click here to reset