An Overview of Lead and Accompaniment Separation in Music

04/23/2018
by   Zafar Rafii, et al.
0

Popular music is often composed of an accompaniment and a lead component, the latter typically consisting of vocals. Filtering such mixtures to extract one or both components has many applications, such as automatic karaoke and remixing. This particular case of source separation yields very specific challenges and opportunities, including the particular complexity of musical structures, but also relevant prior knowledge coming from acoustics, musicology or sound engineering. Due to both its importance in applications and its challenging difficulty, lead and accompaniment separation has been a popular topic in signal processing for decades. In this article, we provide a comprehensive review of this research topic, organizing the different approaches according to whether they are model-based or data-centered. For model-based methods, we organize them according to whether they concentrate on the lead signal, the accompaniment, or both. For data-centered approaches, we discuss the particular difficulty of obtaining data for learning lead separation systems, and then review recent approaches, notably those based on deep learning. Finally, we discuss the delicate problem of evaluating the quality of music separation through adequate metrics and present the results of the largest evaluation, to-date, of lead and accompaniment separation systems. In conjunction with the above, a comprehensive list of references is provided, along with relevant pointers to available implementations and repositories.

READ FULL TEXT

page 3

page 7

page 10

page 20

page 30

research
10/13/2021

Singer separation for karaoke content generation

Due to the rapid development of deep learning, we can now successfully s...
research
03/19/2020

Voice and accompaniment separation in music using self-attention convolutional neural network

Music source separation has been a popular topic in signal processing fo...
research
09/18/2019

Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantity

Music source separation performance has greatly improved in recent years...
research
08/06/2020

Mixing-Specific Data Augmentation Techniques for Improved Blind Violin/Piano Source Separation

Blind music source separation has been a popular and active subject of r...
research
05/12/2023

Benchmarks and leaderboards for sound demixing tasks

Music demixing is the task of separating different tracks from the given...
research
10/22/2020

Transcription Is All You Need: Learning to Separate Musical Mixtures with Score as Supervision

Most music source separation systems require large collections of isolat...

Please sign up or login with your details

Forgot password? Click here to reset