Reservoir computing for spatiotemporal signal classification without trained output weights

04/11/2016
by   Ashley Prater, et al.
0

Reservoir computing is a recently introduced machine learning paradigm that has been shown to be well-suited for the processing of spatiotemporal data. Rather than training the network node connections and weights via backpropagation in traditional recurrent neural networks, reservoirs instead have fixed connections and weights among the `hidden layer' nodes, and traditionally only the weights to the output layer of neurons are trained using linear regression. We claim that for signal classification tasks one may forgo the weight training step entirely and instead use a simple supervised clustering method based upon principal components of norms of reservoir states. The proposed method is mathematically analyzed and explored through numerical experiments on real-world data. The examples demonstrate that the proposed may outperform the traditional trained output weight approach in terms of classification accuracy and sensitivity to reservoir parameters.

READ FULL TEXT
research
10/13/2020

Deep Reservoir Networks with Learned Hidden Reservoir Weights using Direct Feedback Alignment

Deep Reservoir Computing has emerged as a new paradigm for deep learning...
research
03/13/2017

Comparison of echo state network output layer classification methods on noisy data

Echo state networks are a recently developed type of recurrent neural ne...
research
03/08/2021

Cluster-based Input Weight Initialization for Echo State Networks

Echo State Networks (ESNs) are a special type of recurrent neural networ...
research
08/23/2017

Classification via Tensor Decompositions of Echo State Networks

This work introduces a tensor-based method to perform supervised classif...
research
04/06/2020

Large-scale spatiotemporal photonic reservoir computer for image classification

We propose a scalable photonic architecture for implementation of feedfo...
research
06/10/2022

Evolutionary Echo State Network: evolving reservoirs in the Fourier space

The Echo State Network (ESN) is a class of Recurrent Neural Network with...
research
01/11/2021

Exploiting Multiple Timescales in Hierarchical Echo State Networks

Echo state networks (ESNs) are a powerful form of reservoir computing th...

Please sign up or login with your details

Forgot password? Click here to reset