Deep Unsupervised Learning Using Spike-Timing-Dependent Plasticity

07/08/2023
by   Sen Lu, et al.
0

Spike-Timing-Dependent Plasticity (STDP) is an unsupervised learning mechanism for Spiking Neural Networks (SNNs) that has received significant attention from the neuromorphic hardware community. However, scaling such local learning techniques to deeper networks and large-scale tasks has remained elusive. In this work, we investigate a Deep-STDP framework where a convolutional network is trained in tandem with pseudo-labels generated by the STDP clustering process on the network outputs. We achieve 24.56% higher accuracy and 3.5× faster convergence speed at iso-accuracy on a 10-class subset of the Tiny ImageNet dataset in contrast to a k-means clustering approach.

READ FULL TEXT
research
05/31/2021

Characterization of Generalizability of Spike Timing Dependent Plasticity trained Spiking Neural Networks

A Spiking Neural Network (SNN) is trained with Spike Timing Dependent Pl...
research
08/01/2023

Gradient Scaling on Deep Spiking Neural Networks with Spike-Dependent Local Information

Deep spiking neural networks (SNNs) are promising neural networks for th...
research
01/01/2019

A Hardware Friendly Unsupervised Memristive Neural Network with Weight Sharing Mechanism

Memristive neural networks (MNNs), which use memristors as neurons or sy...
research
07/22/2019

Non-Spike Timing-Dependent Plasticity based Unsupervised Memristive Neural Networks with High Hardware Compatibility

With the development of research on memristor, memristive neural network...
research
03/18/2017

A wake-sleep algorithm for recurrent, spiking neural networks

We investigate a recently proposed model for cortical computation which ...
research
06/13/2022

The Classification of Optical Galaxy Morphology Using Unsupervised Learning Techniques

The advent of large scale, data intensive astronomical surveys has cause...
research
02/24/2020

Improving STDP-based Visual Feature Learning with Whitening

In recent years, spiking neural networks (SNNs) emerge as an alternative...

Please sign up or login with your details

Forgot password? Click here to reset