Bootstrapping single-channel source separation via unsupervised spatial clustering on stereo mixtures

by   Prem Seetharaman, et al.

Separating an audio scene into isolated sources is a fundamental problem in computer audition, analogous to image segmentation in visual scene analysis. Source separation systems based on deep learning are currently the most successful approaches for solving the underdetermined separation problem, where there are more sources than channels. Traditionally, such systems are trained on sound mixtures where the ground truth decomposition is already known. Since most real-world recordings do not have such a decomposition available, this limits the range of mixtures one can train on, and the range of mixtures the learned models may successfully separate. In this work, we use a simple blind spatial source separation algorithm to generate estimated decompositions of stereo mixtures. These estimates, together with a weighting scheme in the time-frequency domain, based on confidence in the separation quality, are used to train a deep learning model that can be used for single-channel separation, where no source direction information is available. This demonstrates how a simple cue such as the direction of origin of source can be used to bootstrap a model for source separation that can be used in situations where that cue is not available.


page 3

page 4


Unsupervised Deep Clustering for Source Separation: Direct Learning from Mixtures using Spatial Information

We present a monophonic source separation system that is trained by only...

Bootstrapping deep music separation from primitive auditory grouping principles

Separating an audio scene such as a cocktail party into constituent, mea...

Under-determined reverberant audio source separation using a full-rank spatial covariance model

This article addresses the modeling of reverberant recording environment...

Deep clustering: Discriminative embeddings for segmentation and separation

We address the problem of acoustic source separation in a deep learning ...

Modeling the Repetition-based Recovering of Acoustic and Visual Sources with Dendritic Neurons

In natural auditory environments, acoustic signals originate from the te...

Modeling the Comb Filter Effect and Interaural Coherence for Binaural Source Separation

Typical methods for binaural source separation consider only the direct ...

Shift-Invariant Kernel Additive Modelling for Audio Source Separation

A major goal in blind source separation to identify and separate sources...

Please sign up or login with your details

Forgot password? Click here to reset