Fast MVAE: Joint separation and classification of mixed sources based on multichannel variational autoencoder with auxiliary classifier

12/16/2018
by   Li Li, et al.
0

This paper proposes an alternative algorithm for multichannel variational autoencoder (MVAE), a recently proposed multichannel source separation approach. While MVAE is notable in its impressive source separation performance, the convergence-guaranteed optimization algorithm and that it allows us to estimate source-class labels simultaneously with source separation, there are still two major drawbacks, i.e., the high computational complexity and unsatisfactory source classification accuracy. To overcome these drawbacks, the proposed method employs an auxiliary classifier VAE, an information-theoretic extension of the conditional VAE, for learning the generative model of the source spectrograms. Furthermore, with the trained auxiliary classifier, we introduce a novel algorithm for the optimization that is able to not only reduce the computational time but also improve the source classification performance. We call the proposed method "fast MVAE (fMVAE)". Experimental evaluations revealed that fMVAE achieved comparative source separation performance to MVAE and about 80 rate while it reduced about 93

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/02/2018

Semi-blind source separation with multichannel variational autoencoder

This paper proposes a multichannel source separation method called the m...
research
09/28/2021

FastMVAE2: On improving and accelerating the fast variational autoencoder-based source separation algorithm for determined mixtures

This paper proposes a new source model and training scheme to improve th...
research
09/29/2018

Generalized Multichannel Variational Autoencoder for Underdetermined Source Separation

This paper deals with a multichannel audio source separation problem und...
research
10/31/2018

Weak Label Supervision For Monaural Source Separation Using Non-negative Denoising Variational Autoencoders

Deep learning models are very effective in source separation when there ...
research
05/17/2018

FastFCA: A Joint Diagonalization Based Fast Algorithm for Audio Source Separation Using A Full-Rank Spatial Covariance Model

A source separation method using a full-rank spatial covariance model ha...
research
06/27/2012

Variational Inference in Non-negative Factorial Hidden Markov Models for Efficient Audio Source Separation

The past decade has seen substantial work on the use of non-negative mat...
research
07/04/2022

Semi-blind source separation using convolutive transfer function for nonlinear acoustic echo cancellation

The recently proposed semi-blind source separation (SBSS) method for non...

Please sign up or login with your details

Forgot password? Click here to reset