Multi-modal Blind Source Separation with Microphones and Blinkies

04/04/2019
by   Robin Scheibler, et al.
0

We propose a blind source separation algorithm that jointly exploits measurements by a conventional microphone array and an ad hoc array of low-rate sound power sensors called blinkies. While providing less information than microphones, blinkies circumvent some difficulties of microphone arrays in terms of manufacturing, synchronization, and deployment. The algorithm is derived from a joint probabilistic model of the microphone and sound power measurements. We assume the separated sources to follow a time-varying spherical Gaussian distribution, and the non-negative power measurement space-time matrix to have a low-rank structure. We show that alternating updates similar to those of independent vector analysis and Itakura-Saito non-negative matrix factorization decrease the negative log-likelihood of the joint distribution. The proposed algorithm is validated via numerical experiments. Its median separation performance is found to be up to 8 dB more than that of independent vector analysis, with significantly reduced variability.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

research
06/27/2012

Variational Inference in Non-negative Factorial Hidden Markov Models for Efficient Audio Source Separation

The past decade has seen substantial work on the use of non-negative mat...
research
02/03/2020

Regularized Fast Multichannel Nonnegative Matrix Factorization with ILRMA-based Prior Distribution of Joint-Diagonalization Process

In this paper, we address a convolutive blind source separation (BSS) pr...
research
08/26/2013

Sparse and Non-Negative BSS for Noisy Data

Non-negative blind source separation (BSS) has raised interest in variou...
research
11/18/2014

Nonnegative Tensor Factorization for Directional Blind Audio Source Separation

We augment the nonnegative matrix factorization method for audio source ...
research
01/11/2018

Direction of Arrival with One Microphone, a few LEGOs, and Non-Negative Matrix Factorization

Conventional approaches to sound source localization require at least tw...
research
11/18/2017

Separake: Source Separation with a Little Help From Echoes

It is commonly believed that multipath hurts various audio processing al...
research
04/08/2020

MM Algorithms for Joint Independent Subspace Analysis with Application to Blind Single and Multi-Source Extraction

In this work, we propose efficient algorithms for joint independent subs...

Please sign up or login with your details

Forgot password? Click here to reset