Formation of cell assemblies with iterative winners-take-all computation and excitation-inhibition balance

08/02/2021
by   Viacheslav Osaulenko, et al.
0

This paper targets the problem of encoding information into binary cell assemblies. Spiking neural networks and k-winners-take-all models are two common approaches, but the first is hard to use for information processing and the second is too simple and lacks important features of the first. We present an intermediate model that shares the computational ease of kWTA and has more flexible and richer dynamics. It uses explicit inhibitory neurons to balance and shape excitation through an iterative procedure. This leads to a recurrent interaction between inhibitory and excitatory neurons that better adapts to the input distribution and performs such computations as habituation, decorrelation, and clustering. To show these, we investigate Hebbian-like learning rules and propose a new learning rule for binary weights with multiple stabilization mechanisms. Our source code is publicly available.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/28/2022

The fine line between dead neurons and sparsity in binarized spiking neural networks

Spiking neural networks can compensate for quantization error by encodin...
research
03/31/2015

Encoding Spike Patterns in Multilayer Spiking Neural Networks

Information encoding in the nervous system is supported through the prec...
research
03/15/2021

Constrained plasticity reserve as a natural way to control frequency and weights in spiking neural networks

Biological neurons have adaptive nature and perform complex computations...
research
05/26/2023

Sharing Leaky-Integrate-and-Fire Neurons for Memory-Efficient Spiking Neural Networks

Spiking Neural Networks (SNNs) have gained increasing attention as energ...
research
03/09/2023

Deep Spiking Neural Networks with High Representation Similarity Model Visual Pathways of Macaque and Mouse

Deep artificial neural networks (ANNs) play a major role in modeling the...
research
07/13/2021

A Diffuse Interface Model for Cell Blebbing Including Membrane-Cortex Coupling with Linker Dynamics

The aim of this paper is to develop suitable models for the phenomenon o...

Please sign up or login with your details

Forgot password? Click here to reset