Axonal Delay As a Short-Term Memory for Feed Forward Deep Spiking Neural Networks

04/20/2022
by   Pengfei Sun, et al.
0

The information of spiking neural networks (SNNs) are propagated between the adjacent biological neuron by spikes, which provides a computing paradigm with the promise of simulating the human brain. Recent studies have found that the time delay of neurons plays an important role in the learning process. Therefore, configuring the precise timing of the spike is a promising direction for understanding and improving the transmission process of temporal information in SNNs. However, most of the existing learning methods for spiking neurons are focusing on the adjustment of synaptic weight, while very few research has been working on axonal delay. In this paper, we verify the effectiveness of integrating time delay into supervised learning and propose a module that modulates the axonal delay through short-term memory. To this end, a rectified axonal delay (RAD) module is integrated with the spiking model to align the spike timing and thus improve the characterization learning ability of temporal features. Experiments on three neuromorphic benchmark datasets : NMNIST, DVS Gesture and N-TIDIGITS18 show that the proposed method achieves the state-of-the-art performance while using the fewest parameters.

READ FULL TEXT
research
11/18/2020

Bio-plausible Unsupervised Delay Learning for Extracting Temporal Features in Spiking Neural Networks

The plasticity of the conduction delay between neurons plays a fundament...
research
03/26/2016

A Draft Memory Model on Spiking Neural Assemblies

A draft memory model (DM) for neural networks with spike propagation del...
research
08/31/2021

Astrocytes mediate analogous memory in a multi-layer neuron-astrocytic network

Modeling the neuronal processes underlying short-term working memory rem...
research
06/09/2023

Spike timing reshapes robustness against attacks in spiking neural networks

The success of deep learning in the past decade is partially shrouded in...
research
06/30/2020

Spiking Associative Memory for Spatio-Temporal Patterns

Spike Timing Dependent Plasticity is form of learning that has been demo...
research
05/23/2023

Unsupervised Spiking Neural Network Model of Prefrontal Cortex to study Task Switching with Synaptic deficiency

In this study, we build a computational model of Prefrontal Cortex (PFC)...
research
02/21/2021

STDP enhances learning by backpropagation in a spiking neural network

A semi-supervised learning method for spiking neural networks is propose...

Please sign up or login with your details

Forgot password? Click here to reset