Multi-Tones' Phase Coding (MTPC) of Interaural Time Difference by Spiking Neural Network

by   Zihan Pan, et al.

Inspired by the mammal's auditory localization pathway, in this paper we propose a pure spiking neural network (SNN) based computational model for precise sound localization in the noisy real-world environment, and implement this algorithm in a real-time robotic system with a microphone array. The key of this model relies on the MTPC scheme, which encodes the interaural time difference (ITD) cues into spike patterns. This scheme naturally follows the functional structures of the human auditory localization system, rather than artificially computing of time difference of arrival. Besides, it highlights the advantages of SNN, such as event-driven and power efficiency. The MTPC is pipelined with two different SNN architectures, the convolutional SNN and recurrent SNN, by which it shows the applicability to various SNNs. This proposal is evaluated by the microphone collected location-dependent acoustic data, in a real-world environment with noise, obstruction, reflection, or other affects. The experiment results show a mean error azimuth of 1 3 degrees, which surpasses the accuracy of the other biologically plausible neuromorphic approach for sound source localization.


page 1

page 6

page 8

page 10


SpikiLi: A Spiking Simulation of LiDAR based Real-time Object Detection for Autonomous Driving

Spiking Neural Networks are a recent and new neural network design appro...

Spiking Neural Networks for Frame-based and Event-based Single Object Localization

Spiking neural networks have shown much promise as an energy-efficient a...

An efficient and perceptually motivated auditory neural encoding and decoding algorithm for spiking neural networks

Auditory front-end is an integral part of a spiking neural network (SNN)...

A Hybrid Neural Coding Approach for Pattern Recognition with Spiking Neural Networks

The biological neural systems evolved to adapt to ecological environment...

PT-Spike: A Precise-Time-Dependent Single Spike Neuromorphic Architecture with Efficient Supervised Learning

One of the most exciting advancements in AI over the last decade is the ...

Continuously Learning to Detect People on the Fly: A Bio-inspired Visual System for Drones

This paper demonstrates for the first time that a biologically-plausible...

Please sign up or login with your details

Forgot password? Click here to reset