SPA: Stochastic Probability Adjustment for System Balance of Unsupervised SNNs

10/19/2020
by   Xingyu Yang, et al.
0

Spiking neural networks (SNNs) receive widespread attention because of their low-power hardware characteristic and brain-like signal response mechanism, but currently, the performance of SNNs is still behind Artificial Neural Networks (ANNs). We build an information theory-inspired system called Stochastic Probability Adjustment (SPA) system to reduce this gap. The SPA maps the synapses and neurons of SNNs into a probability space where a neuron and all connected pre-synapses are represented by a cluster. The movement of synaptic transmitter between different clusters is modeled as a Brownian-like stochastic process in which the transmitter distribution is adaptive at different firing phases. We experimented with a wide range of existing unsupervised SNN architectures and achieved consistent performance improvements. The improvements in classification accuracy have reached 1.99 MNIST and EMNIST datasets respectively.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/02/2019

BioSNet: A Fast-Learning and High-Robustness Unsupervised Biomimetic Spiking Neural Network

Spiking Neural Network (SNN), as a brain-inspired machine learning algor...
research
12/10/2018

Spiking Neural Networks: A Stochastic Signal Processing Perspective

Spiking Neural Networks (SNNs) are distributed systems whose computing e...
research
08/04/2023

Paired Competing Neurons Improving STDP Supervised Local Learning In Spiking Neural Networks

Direct training of Spiking Neural Networks (SNNs) on neuromorphic hardwa...
research
11/23/2022

Developmental Plasticity-inspired Adaptive Pruning for Deep Spiking and Artificial Neural Networks

Developmental plasticity plays a prominent role in shaping the brain's s...
research
02/15/2016

Training of spiking neural networks based on information theoretic costs

Spiking neural network is a type of artificial neural network in which n...

Please sign up or login with your details

Forgot password? Click here to reset