Photonic Delay Systems as Machine Learning Implementations

01/12/2015
by   Michiel Hermans, et al.
0

Nonlinear photonic delay systems present interesting implementation platforms for machine learning models. They can be extremely fast, offer great degrees of parallelism and potentially consume far less power than digital processors. So far they have been successfully employed for signal processing using the Reservoir Computing paradigm. In this paper we show that their range of applicability can be greatly extended if we use gradient descent with backpropagation through time on a model of the system to optimize the input encoding of such systems. We perform physical experiments that demonstrate that the obtained input encodings work well in reality, and we show that optimized systems perform significantly better than the common Reservoir Computing approach. The results presented here demonstrate that common gradient descent techniques from machine learning may well be applicable on physical neuro-inspired analog computers.

READ FULL TEXT

page 12

page 13

research
02/23/2018

Reservoir computing with simple oscillators: Virtual and real networks

The reservoir computing scheme is a machine learning mechanism which uti...
research
09/14/2012

Analog readout for optical reservoir computers

Reservoir computing is a new, powerful and flexible machine learning tec...
research
02/06/2018

Brain-inspired photonic signal processor for periodic pattern generation and chaotic system emulation

Reservoir computing is a bio-inspired computing paradigm for processing ...
research
10/20/2016

Embodiment of Learning in Electro-Optical Signal Processors

Delay-coupled electro-optical systems have received much attention for t...
research
07/19/2019

Learning sparsity in reservoir computing through a novel bio-inspired algorithm

The mushroom body is the key network for the representation of learned o...
research
07/24/2014

Trainable and Dynamic Computing: Error Backpropagation through Physical Media

Machine learning algorithms, and more in particular neural networks, arg...
research
05/15/2021

Gradient Descent in Materio

Deep learning, a multi-layered neural network approach inspired by the b...

Please sign up or login with your details

Forgot password? Click here to reset