Auditory Separation of a Conversation from Background via Attentional Gating

05/26/2019
by   Shariq Mobin, et al.
0

We present a model for separating a set of voices out of a sound mixture containing an unknown number of sources. Our Attentional Gating Network (AGN) uses a variable attentional context to specify which speakers in the mixture are of interest. The attentional context is specified by an embedding vector which modifies the processing of a neural network through an additive bias. Individual speaker embeddings are learned to separate a single speaker while superpositions of the individual speaker embeddings are used to separate sets of speakers. We first evaluate AGN on a traditional single speaker separation task and show an improvement of 9 introduce a new task to separate an arbitrary subset of voices from a mixture of an unknown-sized set of voices, inspired by the human ability to separate a conversation of interest from background chatter at a cafeteria. We show that AGN is the only model capable of solving this task, performing only 7 than on the single speaker separation task.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/05/2019

Recursive speech separation for unknown number of speakers

In this paper we propose a method of single-channel speaker-independent ...
research
08/29/2017

Improving Source Separation via Multi-Speaker Representations

Lately there have been novel developments in deep learning towards solvi...
research
03/19/2016

A Persona-Based Neural Conversation Model

We present persona-based models for handling the issue of speaker consis...
research
07/01/2022

Distance-Based Sound Separation

We propose the novel task of distance-based sound separation, where soun...
research
10/12/2020

The Cone of Silence: Speech Separation by Localization

Given a multi-microphone recording of an unknown number of speakers talk...
research
05/12/2017

Monaural Audio Speaker Separation with Source Contrastive Estimation

We propose an algorithm to separate simultaneously speaking persons from...
research
11/30/2018

Neural separation of observed and unobserved distributions

Separating mixed distributions is a long standing challenge for machine ...

Please sign up or login with your details

Forgot password? Click here to reset