Voice and accompaniment separation in music using self-attention convolutional neural network

by   Yuzhou Liu, et al.

Music source separation has been a popular topic in signal processing for decades, not only because of its technical difficulty, but also due to its importance to many commercial applications, such as automatic karoake and remixing. In this work, we propose a novel self-attention network to separate voice and accompaniment in music. First, a convolutional neural network (CNN) with densely-connected CNN blocks is built as our base network. We then insert self-attention subnets at different levels of the base CNN to make use of the long-term intra-dependency of music, i.e., repetition. Within self-attention subnets, repetitions of the same musical patterns inform reconstruction of other repetitions, for better source separation performance. Results show the proposed method leads to 19.5 terms of SDR. We compare our methods with state-of-the-art systems i.e. MMDenseNet and MMDenseLSTM.


page 1

page 2

page 3

page 4


Complex ratio masking for singing voice separation

Music source separation is important for applications such as karaoke an...

CNN self-attention voice activity detector

In this work we present a novel single-channel Voice Activity Detector (...

Music theme recognition using CNN and self-attention

We present an efficient architecture to detect mood/themes in music trac...

An Overview of Lead and Accompaniment Separation in Music

Popular music is often composed of an accompaniment and a lead component...

Music Signal Processing Using Vector Product Neural Networks

We propose a novel neural network model for music signal processing usin...

D3Net: Densely connected multidilated DenseNet for music source separation

Music source separation involves a large input field to model a long-ter...

Hybrid Transformers for Music Source Separation

A natural question arising in Music Source Separation (MSS) is whether l...

Please sign up or login with your details

Forgot password? Click here to reset