Timing-Based Backpropagation in Spiking Neural Networks Without Single-Spike Restrictions

11/29/2022
by   Kakei Yamamoto, et al.
0

We propose a novel backpropagation algorithm for training spiking neural networks (SNNs) that encodes information in the relative multiple spike timing of individual neurons without single-spike restrictions. The proposed algorithm inherits the advantages of conventional timing-based methods in that it computes accurate gradients with respect to spike timing, which promotes ideal temporal coding. Unlike conventional methods where each neuron fires at most once, the proposed algorithm allows each neuron to fire multiple times. This extension naturally improves the computational capacity of SNNs. Our SNN model outperformed comparable SNN models and achieved as high accuracy as non-convolutional artificial neural networks. The spike count property of our networks was altered depending on the time constant of the postsynaptic current and the membrane potential. Moreover, we found that there existed the optimal time constant with the maximum test accuracy. That was not seen in conventional SNNs with single-spike restrictions on time-to-fast-spike (TTFS) coding. This result demonstrates the computational properties of SNNs that biologically encode information into the multi-spike timing of individual neurons. Our code would be publicly available.

READ FULL TEXT
research
07/30/2019

Temporal coding in spiking neural networks with alpha synaptic function

The timing of individual neuronal spikes is essential for biological bra...
research
06/04/2020

Unifying Activation- and Timing-based Learning Rules for Spiking Neural Networks

For the gradient computation across the time domain in Spiking Neural Ne...
research
01/14/2005

Spike timing precision and neural error correction: local behavior

The effects of spike timing precision and dynamical behavior on error co...
research
03/09/2018

On the information in spike timing: neural codes derived from polychronous groups

There is growing evidence regarding the importance of spike timing in ne...
research
07/24/2023

Sparse-firing regularization methods for spiking neural networks with time-to-first spike coding

The training of multilayer spiking neural networks (SNNs) using the erro...
research
11/11/2022

Dance of SNN and ANN: Solving binding problem by combining spike timing and reconstructive attention

The binding problem is one of the fundamental challenges that prevent th...

Please sign up or login with your details

Forgot password? Click here to reset