Critical Echo State Networks that Anticipate Input using Morphable Transfer Functions

06/12/2016
by   Norbert Michael Mayer, et al.
0

The paper investigates a new type of truly critical echo state networks where individual transfer functions for every neuron can be modified to anticipate the expected next input. Deviations from expected input are only forgotten slowly in power law fashion. The paper outlines the theory, numerically analyzes a one neuron model network and finally discusses technical and also biological implications of this type of approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/25/2014

Input anticipating critical reservoirs show power law forgetting of unexpected input events

Usually, reservoir computing shows an exponential memory decay. This pap...
research
04/26/2017

A New Type of Neurons for Machine Learning

In machine learning, the use of an artificial neural network is the main...
research
12/13/2017

Decomposing the Univalence Axiom

This paper investigates the univalence axiom in intensional Martin-Löf t...
research
07/18/2014

Motor Learning Mechanism on the Neuron Scale

Based on existing data, we wish to put forward a biological model of mot...
research
01/28/2012

A Neuron Based Switch: Application to Low Power Mixed Signal Circuits

Human brain is functionally and physically complex. This 'complexity' ca...
research
03/31/2021

Neural Response Interpretation through the Lens of Critical Pathways

Is critical input information encoded in specific sparse pathways within...
research
04/23/2017

A General Theory for Training Learning Machine

Though the deep learning is pushing the machine learning to a new stage,...

Please sign up or login with your details

Forgot password? Click here to reset