Unsupervised Regenerative Learning of Hierarchical Features in Spiking Deep Networks for Object Recognition

02/03/2016
by   Priyadarshini Panda, et al.
0

We present a spike-based unsupervised regenerative learning scheme to train Spiking Deep Networks (SpikeCNN) for object recognition problems using biologically realistic leaky integrate-and-fire neurons. The training methodology is based on the Auto-Encoder learning model wherein the hierarchical network is trained layer wise using the encoder-decoder principle. Regenerative learning uses spike-timing information and inherent latencies to update the weights and learn representative levels for each convolutional layer in an unsupervised manner. The features learnt from the final layer in the hierarchy are then fed to an output layer. The output layer is trained with supervision by showing a fraction of the labeled training dataset and performs the overall classification of the input. Our proposed methodology yields 0.92 with state-of-the-art results. The proposed methodology also introduces sparsity in the hierarchical feature representations on account of event-based coding resulting in computationally efficient learning.

READ FULL TEXT

page 2

page 5

page 6

page 7

research
03/10/2017

Convolutional Spike Timing Dependent Plasticity based Feature Learning in Spiking Neural Networks

Brain-inspired learning models attempt to mimic the cortical architectur...
research
05/20/2022

Efficient visual object representation using a biologically plausible spike-latency code and winner-take-all inhibition

Deep neural networks have surpassed human performance in key visual chal...
research
11/09/2016

Bio-Inspired Spiking Convolutional Neural Network using Layer-wise Sparse Coding and STDP Learning

Hierarchical feature discovery using non-spiking convolutional neural ne...
research
09/22/2021

Training Deep Spiking Auto-encoders without Bursting or Dying Neurons through Regularization

Spiking neural networks are a promising approach towards next-generation...
research
12/20/2013

Neuronal Synchrony in Complex-Valued Deep Networks

Deep learning has recently led to great successes in tasks such as image...
research
11/04/2016

STDP-based spiking deep convolutional neural networks for object recognition

Previous studies have shown that spike-timing-dependent plasticity (STDP...
research
11/28/2014

From neural PCA to deep unsupervised learning

A network supporting deep unsupervised learning is presented. The networ...

Please sign up or login with your details

Forgot password? Click here to reset