DeepAI
Log In Sign Up

Finite Meta-Dynamic Neurons in Spiking Neural Networks for Spatio-temporal Learning

10/07/2020
by   Xiang Cheng, et al.
0

Spiking Neural Networks (SNNs) have incorporated more biologically-plausible structures and learning principles, hence are playing critical roles in bridging the gap between artificial and natural neural networks. The spikes are the sparse signals describing the above-threshold event-based firing and under-threshold dynamic computation of membrane potentials, which give us an alternative uniformed and efficient way on both information representation and computation. Inspired from the biological network, where a finite number of meta neurons integrated together for various of cognitive functions, we proposed and constructed Meta-Dynamic Neurons (MDN) to improve SNNs for a better network generalization during spatio-temporal learning. The MDNs are designed with basic neuronal dynamics containing 1st-order and 2nd-order dynamics of membrane potentials, including the spatial and temporal meta types supported by some hyper-parameters. The MDNs generated from a spatial (MNIST) and a temporal (TIDigits) datasets first, and then extended to various other different spatio-temporal tasks (including Fashion-MNIST, NETtalk, Cifar-10, TIMIT and N-MNIST). The comparable accuracy was reached compared to other SOTA SNN algorithms, and a better generalization was also achieved by SNNs using MDNs than that without using MDNs.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/09/2020

Tuning Convolutional Spiking Neural Network with Biologically-plausible Reward Propagation

Spiking Neural Networks (SNNs) contain more biology-realistic structures...
10/27/2020

Spiking Neural Networks – Part II: Detecting Spatio-Temporal Patterns

Inspired by the operation of biological brains, Spiking Neural Networks ...
11/12/2022

Motif-topology improved Spiking Neural Network for the Cocktail Party Effect and McGurk Effect

Network architectures and learning principles are playing key in forming...
09/02/2017

Training Spiking Neural Networks for Cognitive Tasks: A Versatile Framework Compatible to Various Temporal Codes

Conventional modeling approaches have found limitations in matching the ...
02/11/2022

Motif-topology and Reward-learning improved Spiking Neural Network for Efficient Multi-sensory Integration

Network architectures and learning principles are key in forming complex...
09/12/2017

Spatio-temporal Learning with Arrays of Analog Nanosynapses

Emerging nanodevices such as resistive memories are being considered for...
06/15/2021

Population-coding and Dynamic-neurons improved Spiking Actor Network for Reinforcement Learning

With the Deep Neural Networks (DNNs) as a powerful function approximator...