Deep Spiking Neural Networks with Resonate-and-Fire Neurons

09/16/2021
by   Badr AlKhamissi, et al.
0

In this work, we explore a new Spiking Neural Network (SNN) formulation with Resonate-and-Fire (RAF) neurons (Izhikevich, 2001) trained with gradient descent via back-propagation. The RAF-SNN, while more biologically plausible, achieves performance comparable to or higher than conventional models in the Machine Learning literature across different network configurations, using similar or fewer parameters. Strikingly, the RAF-SNN proves robust against noise induced at testing/training time, under both static and dynamic conditions. Against CNN on MNIST, we show 25 N(0, 0.2) induced noise at testing time. Against LSTM on N-MNIST, we show 70 higher absolute accuracy with 20

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/05/2023

Spiking neural networks with Hebbian plasticity for unsupervised representation learning

We introduce a novel spiking neural network model for learning distribut...
research
06/14/2017

Gradient Descent for Spiking Neural Networks

Much of studies on neural computation are based on network models of sta...
research
10/09/2020

Tuning Convolutional Spiking Neural Network with Biologically-plausible Reward Propagation

Spiking Neural Networks (SNNs) contain more biology-realistic structures...
research
05/17/2022

Function Regression using Spiking DeepONet

One of the main broad applications of deep learning is function regressi...
research
09/09/2023

Training of Spiking Neural Network joint Curriculum Learning Strategy

Starting with small and simple concepts, and gradually introducing compl...
research
08/01/2020

Adaptive Chemotaxis for improved Contour Tracking using Spiking Neural Networks

In this paper we present a Spiking Neural Network (SNN) for autonomous n...
research
06/04/2019

Lattice Map Spiking Neural Networks (LM-SNNs) for Clustering and Classifying Image Data

Spiking neural networks (SNNs) with a lattice architecture are introduce...

Please sign up or login with your details

Forgot password? Click here to reset