Echo State Queueing Network: a new reservoir computing learning tool

12/26/2012
by   Sebastián Basterrech, et al.
0

In the last decade, a new computational paradigm was introduced in the field of Machine Learning, under the name of Reservoir Computing (RC). RC models are neural networks which a recurrent part (the reservoir) that does not participate in the learning process, and the rest of the system where no recurrence (no neural circuit) occurs. This approach has grown rapidly due to its success in solving learning tasks and other computational applications. Some success was also observed with another recently proposed neural network designed using Queueing Theory, the Random Neural Network (RandNN). Both approaches have good properties and identified drawbacks. In this paper, we propose a new RC model called Echo State Queueing Network (ESQN), where we use ideas coming from RandNNs for the design of the reservoir. ESQNs consist in ESNs where the reservoir has a new dynamics inspired by recurrent RandNNs. The paper positions ESQNs in the global Machine Learning area, and provides examples of their use and performances. We show on largely used benchmarks that ESQNs are very accurate tools, and we illustrate how they compare with standard ESNs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/11/2022

Re-visiting Reservoir Computing architectures optimized by Evolutionary Algorithms

For many years, Evolutionary Algorithms (EAs) have been applied to impro...
research
06/10/2022

Evolutionary Echo State Network: evolving reservoirs in the Fourier space

The Echo State Network (ESN) is a class of Recurrent Neural Network with...
research
10/10/2022

Multi-mode fiber reservoir computing overcomes shallow neural networks classifiers

In disordered photonics, one typically tries to characterize the optical...
research
03/17/2022

Euler State Networks

Inspired by the numerical solution of ordinary differential equations, i...
research
06/06/2022

Reservoir Computing in robotics: a review

Reservoir Computing is a relatively new framework created to allow the u...
research
05/07/2017

DropIn: Making Reservoir Computing Neural Networks Robust to Missing Inputs by Dropout

The paper presents a novel, principled approach to train recurrent neura...
research
07/23/2019

Reservoir-size dependent learning in analogue neural networks

The implementation of artificial neural networks in hardware substrates ...

Please sign up or login with your details

Forgot password? Click here to reset