Training Spiking Neural Networks for Cognitive Tasks: A Versatile Framework Compatible to Various Temporal Codes

09/02/2017
by   Chaofei Hong, et al.
0

Conventional modeling approaches have found limitations in matching the increasingly detailed neural network structures and dynamics recorded in experiments to the diverse brain functionalities. On another approach, studies have demonstrated to train spiking neural networks for simple functions using supervised learning. Here, we introduce a modified SpikeProp learning algorithm, which achieved better learning stability in different activity states. In addition, we show biological realistic features such as lateral connections and sparse activities can be included in the network. We demonstrate the versatility of this framework by implementing three well-known temporal codes for different types of cognitive tasks, which are MNIST digits recognition, spatial coordinate transformation, and motor sequence generation. Moreover, we find several characteristic features have evolved alongside the task training, such as selective activity, excitatory-inhibitory balance, and weak pair-wise correlation. The coincidence between the self-evolved and experimentally observed features indicates their importance on the brain functionality. Our results suggest a unified setting in which diverse cognitive computations and mechanisms can be studied.

READ FULL TEXT
research
10/01/2021

Spiking Hyperdimensional Network: Neuromorphic Models Integrated with Memory-Inspired Framework

Recently, brain-inspired computing models have shown great potential to ...
research
10/07/2020

Finite Meta-Dynamic Neurons in Spiking Neural Networks for Spatio-temporal Learning

Spiking Neural Networks (SNNs) have incorporated more biologically-plaus...
research
09/07/2021

Sparse Distributed Memory using Spiking Neural Networks on Nengo

We present a Spiking Neural Network (SNN) based Sparse Distributed Memor...
research
09/10/2017

Cognitive networks: brains, internet, and civilizations

In this short essay, we discuss some basic features of cognitive activit...
research
04/12/2022

A Robust Learning Rule for Soft-Bounded Memristive Synapses Competitive with Supervised Learning in Standard Spiking Neural Networks

Memristive devices are a class of circuit elements that shows great prom...
research
09/18/2023

Adaptive Reorganization of Neural Pathways for Continual Learning with Hybrid Spiking Neural Networks

The human brain can self-organize rich and diverse sparse neural pathway...

Please sign up or login with your details

Forgot password? Click here to reset