DeepAI
Log In Sign Up

Combining Spiking Neural Network and Artificial Neural Network for Enhanced Image Classification

02/21/2021
by   Naoya Muramatsu, et al.
0

With the continued innovations of deep neural networks, spiking neural networks (SNNs) that more closely resemble biological brain synapses have attracted attention owing to their low power consumption.However, for continuous data values, they must employ a coding process to convert the values to spike trains.Thus, they have not yet exceeded the performance of artificial neural networks (ANNs), which handle such values directly.To this end, we combine an ANN and an SNN to build versatile hybrid neural networks (HNNs) that improve the concerned performance.To qualify this performance, MNIST and CIFAR-10 image datasets are used for various classification tasks in which the training and coding methods changes.In addition, we present simultaneous and separate methods to train the artificial and spiking layers, considering the coding methods of each.We find that increasing the number of artificial layers at the expense of spiking layers improves the HNN performance.For straightforward datasets such as MNIST, it is easy to achieve the same performance as ANNs by using duplicate coding and separate learning.However, for more complex tasks, the use of Gaussian coding and simultaneous learning is found to improve the accuracy of HNNs while utilizing a smaller number of artificial layers.

READ FULL TEXT
09/10/2018

Fast and Efficient Information Transmission with Burst Spikes in Deep Spiking Neural Networks

The spiking neural networks (SNNs), the 3rd generation of neural network...
12/02/2019

BioSNet: A Fast-Learning and High-Robustness Unsupervised Biomimetic Spiking Neural Network

Spiking Neural Network (SNN), as a brain-inspired machine learning algor...
03/02/2022

Rethinking Pretraining as a Bridge from ANNs to SNNs

Spiking neural networks (SNNs) are known as a typical kind of brain-insp...
10/19/2021

An Adaptive Sampling and Edge Detection Approach for Encoding Static Images for Spiking Neural Networks

Current state-of-the-art methods of image classification using convoluti...
10/26/2018

Whetstone: A Method for Training Deep Artificial Neural Networks for Binary Communication

This paper presents a new technique for training networks for low-precis...
10/31/2022

A Faster Approach to Spiking Deep Convolutional Neural Networks

Spiking neural networks (SNNs) have closer dynamics to the brain than cu...
01/30/2018

Robustness of classification ability of spiking neural networks

It is well-known that the robustness of artificial neural networks (ANNs...