STDP-based spiking deep convolutional neural networks for object recognition

by   Saeed Reza Kheradpisheh, et al.

Previous studies have shown that spike-timing-dependent plasticity (STDP) can be used in spiking neural networks (SNN) to extract visual features of low or intermediate complexity in an unsupervised manner. These studies, however, used relatively shallow architectures, and only one layer was trainable. Another line of research has demonstrated - using rate-based neural networks trained with back-propagation - that having many layers increases the recognition robustness, an approach known as deep learning. We thus designed a deep SNN, comprising several convolutional (trainable with STDP) and pooling layers. We used a temporal coding scheme where the most strongly activated neurons fire first, and less activated neurons fire later or not at all. The network was exposed to natural images. Thanks to STDP, neurons progressively learned features corresponding to prototypical patterns that were both salient and frequent. Only a few tens of examples per category were required and no label was needed. After learning, the complexity of the extracted features increased along the hierarchy, from edge detectors in the first layer to object prototypes in the last layer. Coding was very sparse, with only a few thousands spikes per image, and in some cases the object category could be reasonably well inferred from the activity of a single higher-order neuron. More generally, the activity of a few hundreds of such neurons contained robust category information, as demonstrated using a classifier on Caltech 101, ETH-80, and MNIST databases. We also demonstrate the superiority of STDP over other unsupervised techniques such as random crops (HMAX) or auto-encoders. Taken together, our results suggest that the combination of STDP with latency coding may be a key to understanding the way that the primate visual system learns, its remarkable processing speed and its low energy consumption.


page 8

page 10

page 12

page 14

page 15


First-spike based visual categorization using reward-modulated STDP

Reinforcement learning (RL) has recently regained popularity, with major...

NatCSNN: A Convolutional Spiking Neural Network for recognition of objects extracted from natural images

Biological image processing is performed by complex neural networks comp...

Bio-Inspired Spiking Convolutional Neural Network using Layer-wise Sparse Coding and STDP Learning

Hierarchical feature discovery using non-spiking convolutional neural ne...

Optimal localist and distributed coding of spatiotemporal spike patterns through STDP and coincidence detection

Repeating spatiotemporal spike patterns exist and carry information. Her...

Bio-inspired Unsupervised Learning of Visual Features Leads to Robust Invariant Object Recognition

Retinal image of surrounding objects varies tremendously due to the chan...

Direct training based spiking convolutional neural networks for object recognition

Direct training based spiking neural networks (SNNs) have been paid a lo...

Unsupervised Regenerative Learning of Hierarchical Features in Spiking Deep Networks for Object Recognition

We present a spike-based unsupervised regenerative learning scheme to tr...

Please sign up or login with your details

Forgot password? Click here to reset