The principle of weight divergence facilitation for unsupervised pattern recognition in spiking neural networks

04/20/2021
by   Oleg Nikitin, et al.
0

Parallels between the signal processing tasks and biological neurons lead to an understanding of the principles of self-organized optimization of input signal recognition. In the present paper, we discuss such similarities among biological and technical systems. We propose the addition to the well-known STDP synaptic plasticity rule to directs the weight modification towards the state associated with the maximal difference between the background noise and correlated signals. The principle of physically constrained weight growth is used as a basis for such control of the modification of the weights. It is proposed, that biological synaptic straight modification is restricted by the existence and production of bio-chemical 'substances' needed for plasticity development. In this paper, the information about the noise-to-signal ratio is used to control such a substances' production and storage and to drive the neuron's synaptic pressures towards the state with the best signal-to-noise ratio. Several experiments with different input signal regimes are considered to understand the functioning of the proposed approach.

READ FULL TEXT

page 5

page 6

page 7

page 8

research
03/15/2021

Constrained plasticity reserve as a natural way to control frequency and weights in spiking neural networks

Biological neurons have adaptive nature and perform complex computations...
research
10/11/2019

A Mathematical Analysis of Memory Lifetime in a simple Network Model of Memory

We study the learning of an external signal by a neural network and the ...
research
01/14/2016

Supervised Learning in Spiking Neural Networks for Precise Temporal Encoding

Precise spike timing as a means to encode information in neural networks...
research
04/30/2018

Interpreting weight maps in terms of cognitive or clinical neuroscience: nonsense?

Since machine learning models have been applied to neuroimaging data, re...
research
03/22/2017

ASP: Learning to Forget with Adaptive Synaptic Plasticity in Spiking Neural Networks

A fundamental feature of learning in animals is the "ability to forget" ...
research
03/21/2023

Online Transformers with Spiking Neurons for Fast Prosthetic Hand Control

Transformers are state-of-the-art networks for most sequence processing ...
research
04/20/2022

Noise mitigation strategies in physical feedforward neural networks

Physical neural networks are promising candidates for next generation ar...

Please sign up or login with your details

Forgot password? Click here to reset