SVSGAN: Singing Voice Separation via Generative Adversarial Network

10/31/2017
by   Zhe-Cheng Fan, et al.
0

Separating two sources from an audio mixture is an important task with many applications. It is a challenging problem since only one signal channel is available for analysis. In this paper, we propose a novel framework for singing voice separation using the generative adversarial network (GAN) with a time-frequency masking function. The mixture spectra is considered to be a distribution and is mapped to the clean spectra which is also considered a distribtution. The approximation of distributions between mixture spectra and clean spectra is performed during the adversarial training process. In contrast with current deep learning approaches for source separation, the parameters of the proposed framework are first initialized in a supervised setting and then optimized by the training procedure of GAN in an unsupervised setting. Experimental results on three datasets (MIR-1K, iKala and DSD100) show that performance can be improved by the proposed framework consisting of conventional networks.

READ FULL TEXT

page 2

page 3

research
06/14/2019

Single-Channel Signal Separation and Deconvolution with Generative Adversarial Networks

Single-channel signal separation and deconvolution aims to separate and ...
research
10/31/2017

Adversarial Semi-Supervised Audio Source Separation applied to Singing Voice Extraction

The state of the art in music source separation employs neural networks ...
research
05/03/2018

Single-Channel Blind Source Separation for Singing Voice Detection: A Comparative Study

We propose a novel unsupervised singing voice detection method which use...
research
03/02/2020

Multichannel Singing Voice Separation by Deep Neural Network Informed DOA Constrained CNMF

This work addresses the problem of multichannel source separation combin...
research
08/29/2019

Deep Bayesian Unsupervised Source Separation Based on a Complex Gaussian Mixture Model

This paper presents an unsupervised method that trains neural source sep...
research
04/08/2020

Inpainting via Generative Adversarial Networks for CMB data analysis

In this work, we propose a new method to inpaint the CMB signal in regio...
research
05/15/2022

High-Resolution CMB Lensing Reconstruction with Deep Learning

Next-generation cosmic microwave background (CMB) surveys are expected t...

Please sign up or login with your details

Forgot password? Click here to reset