Bio-Inspired Multi-Layer Spiking Neural Network Extracts Discriminative Features from Speech Signals

06/10/2017
by   Amirhossein Tavanaei, et al.
0

Spiking neural networks (SNNs) enable power-efficient implementations due to their sparse, spike-based coding scheme. This paper develops a bio-inspired SNN that uses unsupervised learning to extract discriminative features from speech signals, which can subsequently be used in a classifier. The architecture consists of a spiking convolutional/pooling layer followed by a fully connected spiking layer for feature discovery. The convolutional layer of leaky, integrate-and-fire (LIF) neurons represents primary acoustic features. The fully connected layer is equipped with a probabilistic spike-timing-dependent plasticity learning rule. This layer represents the discriminative features through probabilistic, LIF neurons. To assess the discriminative power of the learned features, they are used in a hidden Markov model (HMM) for spoken digit recognition. The experimental results show performance above 96 favorably with popular statistical feature extraction methods. Our results provide a novel demonstration of unsupervised feature acquisition in an SNN.

READ FULL TEXT
research
11/09/2016

Bio-Inspired Spiking Convolutional Neural Network using Layer-wise Sparse Coding and STDP Learning

Hierarchical feature discovery using non-spiking convolutional neural ne...
research
06/02/2016

A Spiking Network that Learns to Extract Spike Signatures from Speech Signals

Spiking neural networks (SNNs) with adaptive synapses reflect core prope...
research
05/15/2017

Sparse Coding by Spiking Neural Networks: Convergence Theory and Computational Results

In a spiking neural network (SNN), individual neurons operate autonomous...
research
06/03/2016

Acquisition of Visual Features Through Probabilistic Spike-Timing-Dependent Plasticity

The final version of this paper has been published in IEEEXplore availab...
research
02/11/2019

ReStoCNet: Residual Stochastic Binary Convolutional Spiking Neural Network for Memory-Efficient Neuromorphic Computing

In this work, we propose ReStoCNet, a residual stochastic multilayer con...
research
01/29/2020

Spiking Inception Module for Multi-layer Unsupervised Spiking Neural Networks

Spiking Neural Network (SNN), as a brain-inspired approach, is attractin...
research
06/02/2016

Training a Hidden Markov Model with a Bayesian Spiking Neural Network

It is of some interest to understand how statistically based mechanisms ...

Please sign up or login with your details

Forgot password? Click here to reset