A Synapse-Threshold Synergistic Learning Approach for Spiking Neural Networks

06/10/2022
by   Hongze Sun, et al.
11

Spiking neural networks (SNNs) have demonstrated excellent capabilities in various intelligent scenarios. Most existing methods for training SNNs are based on the concept of synaptic plasticity; however, learning in the realistic brain also utilizes intrinsic non-synaptic mechanisms of neurons. The spike threshold of biological neurons is a critical intrinsic neuronal feature that exhibits rich dynamics on a millisecond timescale and has been proposed as an underlying mechanism that facilitates neural information processing. In this study, we develop a novel synergistic learning approach that simultaneously trains synaptic weights and spike thresholds in SNNs. SNNs trained with synapse-threshold synergistic learning (STL-SNNs) achieve significantly higher accuracies on various static and neuromorphic datasets than SNNs trained with two single-learning models of the synaptic learning (SL) and the threshold learning (TL). During training, the synergistic learning approach optimizes neural thresholds, providing the network with stable signal transmission via appropriate firing rates. Further analysis indicates that STL-SNNs are robust to noisy data and exhibit low energy consumption for deep network structures. Additionally, the performance of STL-SNN can be further improved by introducing a generalized joint decision framework (JDF). Overall, our findings indicate that biologically plausible synergies between synaptic and intrinsic non-synaptic mechanisms may provide a promising approach for developing highly efficient SNN learning methods.

READ FULL TEXT

page 1

page 5

page 9

research
12/17/2018

A Biologically Plausible Supervised Learning Method for Spiking Neural Networks Using the Symmetric STDP Rule

Spiking neural networks (SNNs) possess energy-efficient potential due to...
research
06/06/2019

Stochasticity and Robustness in Spiking Neural Networks

Artificial neural networks normally require precise weights to operate, ...
research
09/24/2017

Spiking neurons with short-term synaptic plasticity form superior generative networks

Spiking networks that perform probabilistic inference have been proposed...
research
12/29/2022

Tuning Synaptic Connections instead of Weights by Genetic Algorithm in Spiking Policy Network

Learning from the interaction is the primary way biological agents know ...
research
03/13/2018

A case for multiple and parallel RRAMs as synaptic model for training SNNs

To enable a dense integration of model synapses in a spiking neural netw...
research
07/25/2005

Network Topology influences Synchronization and Intrinsic Read-out

What are the effects of neuromodulation on a large network model? Neurom...
research
06/09/2022

Biologically Inspired Dynamic Thresholds for Spiking Neural Networks

The dynamic membrane potential threshold, as one of the essential proper...

Please sign up or login with your details

Forgot password? Click here to reset