Log In Sign Up

Finite Meta-Dynamic Neurons in Spiking Neural Networks for Spatio-temporal Learning

by   Xiang Cheng, et al.

Spiking Neural Networks (SNNs) have incorporated more biologically-plausible structures and learning principles, hence are playing critical roles in bridging the gap between artificial and natural neural networks. The spikes are the sparse signals describing the above-threshold event-based firing and under-threshold dynamic computation of membrane potentials, which give us an alternative uniformed and efficient way on both information representation and computation. Inspired from the biological network, where a finite number of meta neurons integrated together for various of cognitive functions, we proposed and constructed Meta-Dynamic Neurons (MDN) to improve SNNs for a better network generalization during spatio-temporal learning. The MDNs are designed with basic neuronal dynamics containing 1st-order and 2nd-order dynamics of membrane potentials, including the spatial and temporal meta types supported by some hyper-parameters. The MDNs generated from a spatial (MNIST) and a temporal (TIDigits) datasets first, and then extended to various other different spatio-temporal tasks (including Fashion-MNIST, NETtalk, Cifar-10, TIMIT and N-MNIST). The comparable accuracy was reached compared to other SOTA SNN algorithms, and a better generalization was also achieved by SNNs using MDNs than that without using MDNs.


page 1

page 2

page 3

page 4


Tuning Convolutional Spiking Neural Network with Biologically-plausible Reward Propagation

Spiking Neural Networks (SNNs) contain more biology-realistic structures...

Spiking Neural Networks – Part II: Detecting Spatio-Temporal Patterns

Inspired by the operation of biological brains, Spiking Neural Networks ...

Motif-topology improved Spiking Neural Network for the Cocktail Party Effect and McGurk Effect

Network architectures and learning principles are playing key in forming...

Training Spiking Neural Networks for Cognitive Tasks: A Versatile Framework Compatible to Various Temporal Codes

Conventional modeling approaches have found limitations in matching the ...

Motif-topology and Reward-learning improved Spiking Neural Network for Efficient Multi-sensory Integration

Network architectures and learning principles are key in forming complex...

Spatio-temporal Learning with Arrays of Analog Nanosynapses

Emerging nanodevices such as resistive memories are being considered for...

Population-coding and Dynamic-neurons improved Spiking Actor Network for Reinforcement Learning

With the Deep Neural Networks (DNNs) as a powerful function approximator...