Investigating Deep Neural Transformations for Spectrogram-based Musical Source Separation

12/02/2019
by   Woosung Choi, et al.
1

Musical Source Separation (MSS) is a signal processing task that tries to separate the mixed musical signal into each acoustic sound source, such as singing voice or drums. Recently many machine learning-based methods have been proposed for the MSS task, but there were no existing works that evaluate and directly compare various types of networks. In this paper, we aim to design a variety of neural transformation methods, including time-invariant methods, time-frequency methods, and mixtures of two different transformations. Our experiments provide abundant material for future works by comparing several transformation methods. We train our models on raw complex-valued STFT outputs and achieve state-of-the-art SDR performance in the MUSDB18 singing voice separation task by a large margin of 1.0 dB.

READ FULL TEXT

page 1

page 7

research
04/17/2015

Deep Karaoke: Extracting Vocals from Musical Mixtures Using a Convolutional Deep Neural Network

Identification and extraction of singing voice from within musical mixtu...
research
02/01/2018

MaD TwinNet: Masker-Denoiser Architecture with Twin Networks for Monaural Sound Source Separation

Monaural singing voice separation task focuses on the prediction of the ...
research
05/19/2023

Direction Specific Ambisonics Source Separation with End-To-End Deep Learning

Ambisonics is a scene-based spatial audio format that has several useful...
research
02/12/2020

Content Based Singing Voice Extraction From a Musical Mixture

We present a deep learning based methodology for extracting the singing ...
research
03/25/2022

SeCo: Separating Unknown Musical Visual Sounds with Consistency Guidance

Recent years have witnessed the success of deep learning on the visual s...
research
11/04/2017

Monaural Singing Voice Separation with Skip-Filtering Connections and Recurrent Inference of Time-Frequency Mask

Singing voice separation based on deep learning relies on the usage of t...
research
06/29/2017

Music Signal Processing Using Vector Product Neural Networks

We propose a novel neural network model for music signal processing usin...

Please sign up or login with your details

Forgot password? Click here to reset