DeepAI AI Chat
Log In Sign Up

CatNet: music source separation system with mix-audio augmentation

02/19/2021
by   Xuchen Song, et al.
1

Music source separation (MSS) is the task of separating a music piece into individual sources, such as vocals and accompaniment. Recently, neural network based methods have been applied to address the MSS problem, and can be categorized into spectrogram and time-domain based methods. However, there is a lack of research of using complementary information of spectrogram and time-domain inputs for MSS. In this article, we propose a CatNet framework that concatenates a UNet separation branch using spectrogram as input and a WavUNet separation branch using time-domain waveform as input for MSS. We propose an end-to-end and fully differentiable system that incorporate spectrogram calculation into CatNet. In addition, we propose a novel mix-audio data augmentation method that randomly mix audio segments from the same source as augmented audio segments for training. Our proposed CatNet MSS system achieves a state-of-the-art vocals separation source distortion ratio (SDR) of 7.54 dB, outperforming MMDenseNet of 6.57 dB evaluated on the MUSDB18 dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/27/2020

Remixing Music with Visual Conditioning

We propose a visually conditioned music remixing system by incorporating...
11/27/2019

Music Source Separation in the Waveform Domain

Source separation for music is the task of isolating contributions, or s...
08/30/2022

Towards robust music source separation on loud commercial music

Nowadays, commercial music has extreme loudness and heavily compressed d...
10/05/2020

D3Net: Densely connected multidilated DenseNet for music source separation

Music source separation involves a large input field to model a long-ter...
11/24/2021

KUIELab-MDX-Net: A Two-Stream Neural Network for Music Demixing

Recently, many methods based on deep learning have been proposed for mus...
07/28/2021

Neural Remixer: Learning to Remix Music with Interactive Control

The task of manipulating the level and/or effects of individual instrume...
03/07/2021

HTMD-Net: A Hybrid Masking-Denoising Approach to Time-Domain Monaural Singing Voice Separation

The advent of deep learning has led to the prevalence of deep neural net...