A Deep Unsupervised Feature Learning Spiking Neural Network with Binarized Classification Layers for EMNIST Classification

02/26/2020
by   Ruthvik Vaila, et al.
32

End user AI is trained on large server farms with data collected from the users. With ever increasing demand for IOT devices, there is a need for deep learning approaches that can be implemented (at the edge) in an energy efficient manner. In this work we approach this using spiking neural networks. The unsupervised learning technique of spike timing dependent plasticity (STDP) using binary activations are used to extract features from spiking input data. Gradient descent (backpropagation) is used only on the output layer to perform the training for classification. The accuracies obtained for the balanced EMNIST data set compare favorably with other approaches. The effect of stochastic gradient descent (SGD) approximations on learning capabilities of our network are also explored.

READ FULL TEXT

page 4

page 7

page 8

page 9

page 11

page 12

page 13

page 14

research
03/28/2019

Deep Convolutional Spiking Neural Networks for Image Classification

Spiking neural networks are biologically plausible counterparts of the a...
research
08/02/2022

Making a Spiking Net Work: Robust brain-like unsupervised machine learning

The surge in interest in Artificial Intelligence (AI) over the past deca...
research
05/31/2021

Characterization of Generalizability of Spike Timing Dependent Plasticity trained Spiking Neural Networks

A Spiking Neural Network (SNN) is trained with Spike Timing Dependent Pl...
research
09/27/2021

Training Spiking Neural Networks Using Lessons From Deep Learning

The brain is the perfect place to look for inspiration to develop more e...
research
09/30/2022

A Novel Explainable Out-of-Distribution Detection Approach for Spiking Neural Networks

Research around Spiking Neural Networks has ignited during the last year...
research
11/08/2016

An Efficient Approach to Boosting Performance of Deep Spiking Network Training

Nowadays deep learning is dominating the field of machine learning with ...
research
01/14/2019

Unsupervised Visual Feature Learning with Spike-timing-dependent Plasticity: How Far are we from Traditional Feature Learning Approaches?

Spiking neural networks (SNNs) equipped with latency coding and spike-ti...

Please sign up or login with your details

Forgot password? Click here to reset