Training of photonic neural networks through in situ backpropagation

05/25/2018
by   Tyler W. Hughes, et al.
0

Recently, integrated optics has gained interest as a hardware platform for implementing machine learning algorithms. Of particular interest are artificial neural networks, since matrix-vector multi- plications, which are used heavily in artificial neural networks, can be done efficiently in photonic circuits. The training of an artificial neural network is a crucial step in its application. However, currently on the integrated photonics platform there is no efficient protocol for the training of these networks. In this work, we introduce a method that enables highly efficient, in situ training of a photonic neural network. We use adjoint variable methods to derive the photonic analogue of the backpropagation algorithm, which is the standard method for computing gradients of conventional neural networks. We further show how these gradients may be obtained exactly by performing intensity measurements within the device. As an application, we demonstrate the training of a numerically simulated photonic artificial neural network. Beyond the training of photonic machine learning implementations, our method may also be of broad interest to experimental sensitivity analysis of photonic systems and the optimization of reconfigurable optics platforms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/17/2019

Artificial Neural Networks

These are lecture notes for my course on Artificial Neural Networks that...
research
08/07/2017

Parallelizing Over Artificial Neural Network Training Runs with Multigrid

Artificial neural networks are a popular and effective machine learning ...
research
04/29/2020

Reduced Bond Graph via machine learning for nonlinear multiphysics dynamic systems

We propose a machine learning approach aiming at reducing Bond Graphs. T...
research
02/12/2015

Web spam classification using supervised artificial neural network algorithms

Due to the rapid growth in technology employed by the spammers, there is...
research
09/29/2013

An Application of Backpropagation Artificial Neural Network Method for Measuring The Severity of Osteoarthritis

The examination of Osteoarthritis disease through X-ray by rheumatology ...
research
11/06/2019

Correlated Feature Selection for Tweet Spam Classification using Artificial Neural Networks

Identification of spam messages is a very challenging task for social ne...
research
11/30/2020

Monadic Pavlovian associative learning in a backpropagation-free photonic network

Over a century ago, Ivan P. Pavlov, in a classic experiment, demonstrate...

Please sign up or login with your details

Forgot password? Click here to reset