Modeling the Comb Filter Effect and Interaural Coherence for Binaural Source Separation

10/04/2019
by   Luca Remaggi, et al.
0

Typical methods for binaural source separation consider only the direct sound as the target signal in a mixture. However, in most scenarios, this assumption limits the source separation performance. It is well known that the early reflections interact with the direct sound, producing acoustic effects at the listening position, e.g. the so-called comb filter effect. In this article, we propose a novel source separation model, that utilizes both the direct sound and the first early reflection information to model the comb filter effect. This is done by observing the interaural phase difference obtained from the time-frequency representation of binaural mixtures. Furthermore, a method is proposed to model the interaural coherence of the signals. Including information related to the sound multipath propagation, the performance of the proposed separation method is improved with respect to the baselines that did not use such information, as illustrated by using binaural recordings made in four rooms, having different sizes and reverberation times.

READ FULL TEXT

page 1

page 4

page 9

page 14

research
11/05/2018

Unsupervised Deep Clustering for Source Separation: Direct Learning from Mixtures using Spatial Information

We present a monophonic source separation system that is trained by only...
research
11/06/2018

Bootstrapping single-channel source separation via unsupervised spatial clustering on stereo mixtures

Separating an audio scene into isolated sources is a fundamental problem...
research
05/19/2023

Direction Specific Ambisonics Source Separation with End-To-End Deep Learning

Ambisonics is a scene-based spatial audio format that has several useful...
research
04/06/2018

Does k Matter? k-NN Hubness Analysis for Kernel Additive Modelling Vocal Separation

Kernel Additive Modelling (KAM) is a framework for source separation aim...
research
06/30/2021

Fast processing explains the effect of sound reflection on binaural unmasking

Sound reflections and late reverberation alter energetic and binaural cu...
research
12/09/2022

Hyperbolic Audio Source Separation

We introduce a framework for audio source separation using embeddings on...
research
06/10/2020

Listen to What You Want: Neural Network-based Universal Sound Selector

Being able to control the acoustic events (AEs) to which we want to list...

Please sign up or login with your details

Forgot password? Click here to reset