Going Deeper in Spiking Neural Networks: VGG and Residual Architectures

02/07/2018
by   Abhronil Sengupta, et al.
0

Over the past few years, Spiking Neural Networks (SNNs) have become popular as a possible pathway to enable low-power event-driven neuromorphic hardware. However, their application in machine learning have largely been limited to very shallow neural network architectures for simple problems. In this paper, we propose a novel algorithmic technique for generating an SNN with a deep architecture, and demonstrate its effectiveness on complex visual recognition problems such as CIFAR-10 and ImageNet. Our technique applies to both VGG and Residual network architectures, with significantly better accuracy than the state-of-the-art. Finally, we present analysis of the sparse event-driven computations to demonstrate reduced hardware overhead when operating in the spiking domain.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/24/2023

Spikingformer: Spike-driven Residual Learning for Transformer-based Spiking Neural Network

Spiking neural networks (SNNs) offer a promising energy-efficient altern...
research
10/06/2021

Adversarial Attacks on Spiking Convolutional Networks for Event-based Vision

Event-based sensing using dynamic vision sensors is gaining traction in ...
research
07/18/2022

Residual and Attentional Architectures for Vector-Symbols

Vector-symbolic architectures (VSAs) provide methods for computing which...
research
11/10/2021

Keys to Accurate Feature Extraction Using Residual Spiking Neural Networks

Spiking neural networks (SNNs) have become an interesting alternative to...
research
04/02/2013

Event management for large scale event-driven digital hardware spiking neural networks

The interest in brain-like computation has led to the design of a pletho...
research
05/17/2022

Function Regression using Spiking DeepONet

One of the main broad applications of deep learning is function regressi...
research
01/23/2020

On the computational power and complexity of Spiking Neural Networks

The last decade has seen the rise of neuromorphic architectures based on...

Please sign up or login with your details

Forgot password? Click here to reset