A Comprehensive Survey on Deep Music Generation: Multi-level Representations, Algorithms, Evaluations, and Future Directions

11/13/2020
by   Shulei Ji, et al.
50

The utilization of deep learning techniques in generating various contents (such as image, text, etc.) has become a trend. Especially music, the topic of this paper, has attracted widespread attention of countless researchers.The whole process of producing music can be divided into three stages, corresponding to the three levels of music generation: score generation produces scores, performance generation adds performance characteristics to the scores, and audio generation converts scores with performance characteristics into audio by assigning timbre or generates music in audio format directly. Previous surveys have explored the network models employed in the field of automatic music generation. However, the development history, the model evolution, as well as the pros and cons of same music generation task have not been clearly illustrated. This paper attempts to provide an overview of various composition tasks under different music generation levels, covering most of the currently popular music generation tasks using deep learning. In addition, we summarize the datasets suitable for diverse tasks, discuss the music representations, the evaluation methods as well as the challenges under different levels, and finally point out several future directions.

READ FULL TEXT

page 2

page 3

page 15

page 16

page 24

page 34

research
05/10/2021

Personalized Popular Music Generation Using Imitation and Structure

Many practices have been presented in music generation recently. While s...
research
09/01/2022

What is missing in deep music generation? A study of repetition and structure in popular music

Structure is one of the most essential aspects of music, and music struc...
research
08/17/2020

POP909: A Pop-song Dataset for Music Arrangement Generation

Music arrangement generation is a subtask of automatic music generation,...
research
07/12/2022

ReLyMe: Improving Lyric-to-Melody Generation by Incorporating Lyric-Melody Relationships

Lyric-to-melody generation, which generates melody according to given ly...
research
10/26/2019

A holistic approach to polyphonic music transcription with neural networks

We present a framework based on neural networks to extract music scores ...
research
10/26/2020

Shimon the Robot Film Composer and DeepScore: An LSTM for Generation of Film Scores based on Visual Analysis

Composing for a film requires developing an understanding of the film, i...
research
12/09/2017

Music Generation by Deep Learning - Challenges and Directions

In addition to traditional tasks such as prediction, classification and ...

Please sign up or login with your details

Forgot password? Click here to reset