Sound Localization and Separation in Three-dimensional Space Using a Single Microphone with a Metamaterial Enclosure

by   Xuecong Sun, et al.

Conventional approaches to sound localization and separation are based on microphone arrays in artificial systems. Inspired by the selective perception of human auditory system, we design a multi-source listening system which can separate simultaneous overlapping sounds and localize the sound sources in three-dimensional space, using only a single microphone with a metamaterial enclosure. The enclosure modifies the frequency response of the microphone in a direction-dependent way by giving each direction a signature. Thus, the information about the location and audio content of sound sources can be experimentally reconstructed from the modulated mixed signals using compressive sensing algorithm. Owing to the low computational complexity of the proposed reconstruction algorithm, the designed system can also be applied in source identification and tracking. The effectiveness of the system in multiple real scenarios has been proved through multiple random listening tests. The proposed metamaterial-based single-sensor listening system opens a new way of sound localization and separation, which can be applied to intelligent scene monitoring and robot audition.



page 7


Direction of Arrival with One Microphone, a few LEGOs, and Non-Negative Matrix Factorization

Conventional approaches to sound source localization require at least tw...

Localization of Sound Sources in a Room with One Microphone

Estimation of the location of sound sources is usually done using microp...

Sound Event Localization based on Sound Intensity Vector Refined By DNN-Based Denoising and Source Separation

We propose a direction-of-arrival (DOA) estimation method for Sound Even...

Lightweight and Optimized Sound Source Localization and Tracking Methods for Open and Closed Microphone Array Configurations

Human-robot interaction in natural settings requires filtering out the d...

Deep Neural Networks for Multiple Speaker Detection and Localization

We propose to use neural networks (NNs) for simultaneous detection and l...

Sound masking degrades perception of self-location during stepping: A case for sound-transparent spacesuits for Mars

Most efforts to improve spacesuits have been directed towards adding hap...

Joint 3D Localization and Classification of Space Debris using a Multispectral Rotating Point Spread Function

We consider the problem of joint three-dimensional (3D) localization and...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.