Spiking Associative Memory for Spatio-Temporal Patterns

06/30/2020
by   Simon Davidson, et al.
0

Spike Timing Dependent Plasticity is form of learning that has been demonstrated in real cortical tissue, but attempts to use it for artificial systems have not produced good results. This paper seeks to remedy this with two significant advances. The first is the development a simple stochastic learning rule called cyclic STDP that can extract patterns encoded in the precise spiking times of a group of neurons. We show that a population of neurons endowed with this learning rule can act as an effective short-term associative memory, storing and reliably recalling a large set of pattern associations over an extended period of time. The second major theme examines the challenges associated with training a neuron to produce a spike at a precise time and for the fidelity of spike recall time to be maintained as further learning occurs. The strong constraint of working with precisely-timed spikes (so-called temporal coding) is mandated by the learning rule but is also consistent with the believe in the necessity of such an encoding scheme to render a spiking neural network a competitive solution for flexible intelligent systems in continuous learning environments. The encoding and learning rules are demonstrated in the design of a single-layer associative memory (an input layer consisting of 3,200 spiking neurons fully-connected to a similar sized population of memory neurons), which we simulate and characterise. Design considerations and clarification of the role of parameters under the control of the designer are explored.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/31/2015

Encoding Spike Patterns in Multilayer Spiking Neural Networks

Information encoding in the nervous system is supported through the prec...
research
04/25/2021

Neurodynamical Role of STDP in Storage and Retrieval of Associative Information

Spike-timing-dependent plasticity (STDP) is a biological process in whic...
research
05/08/2020

Learning Precise Spike Timings with Eligibility Traces

Recent research in the field of spiking neural networks (SNNs) has shown...
research
04/20/2022

Axonal Delay As a Short-Term Memory for Feed Forward Deep Spiking Neural Networks

The information of spiking neural networks (SNNs) are propagated between...
research
09/12/2019

Neural Population Coding for Effective Temporal Classification

Neural encoding plays an important role in faithfully describing the tem...
research
11/21/2006

Learning and discrimination through STDP in a top-down modulated associative memory

This article underlines the learning and discrimination capabilities of ...
research
08/30/2017

Continual One-Shot Learning of Hidden Spike-Patterns with Neural Network Simulation Expansion and STDP Convergence Predictions

This paper presents a constructive algorithm that achieves successful on...

Please sign up or login with your details

Forgot password? Click here to reset