An efficient and perceptually motivated auditory neural encoding and decoding algorithm for spiking neural networks

by   Zihan Pan, et al.

Auditory front-end is an integral part of a spiking neural network (SNN) when performing auditory cognitive tasks. It encodes the temporal dynamic stimulus, such as speech and audio, into an efficient, effective and reconstructable spike pattern to facilitate the subsequent processing. However, most of the auditory front-ends in current studies have not made use of recent findings in psychoacoustics and physiology concerning human listening. In this paper, we propose a neural encoding and decoding scheme that is optimized for speech processing. The neural encoding scheme, that we call Biologically plausible Auditory Encoding (BAE), emulates the functions of the perceptual components of the human auditory system, that include the cochlear filter bank, the inner hair cells, auditory masking effects from psychoacoustic models, and the spike neural encoding by the auditory nerve. We evaluate the perceptual quality of the BAE scheme using PESQ; the performance of the BAE based on speech recognition experiments. Finally, we also built and published two spike-version of speech datasets: the Spike-TIDIGITS and the Spike-TIMIT, for researchers to use and benchmarking of future SNN research.


page 5

page 6

page 7

page 12

page 13

page 14

page 15

page 18


Spiking-LEAF: A Learnable Auditory front-end for Spiking Neural Networks

Brain-inspired spiking neural networks (SNNs) have demonstrated great po...

Evaluation of Neuromorphic Spike Encoding of Sound Using Information Theory

The problem of spike encoding of sound consists in transforming a sound ...

Exploiting a Stimuli Encoding Scheme of Spiking Neural Networks for Stream Learning

Stream data processing has gained progressive momentum with the arriving...

Multi-Tones' Phase Coding (MTPC) of Interaural Time Difference by Spiking Neural Network

Inspired by the mammal's auditory localization pathway, in this paper we...

Custom DNN using Reward Modulated Inverted STDP Learning for Temporal Pattern Recognition

Temporal spike recognition plays a crucial role in various domains, incl...

Efficient spike encoding algorithms for neuromorphic speech recognition

Spiking Neural Networks (SNN) are known to be very effective for neuromo...

E3NE: An End-to-End Framework for Accelerating Spiking Neural Networks with Emerging Neural Encoding on FPGAs

Compiler frameworks are crucial for the widespread use of FPGA-based dee...

Please sign up or login with your details

Forgot password? Click here to reset