A Comprehensive Survey on Deep Music Generation: Multi-level Representations, Algorithms, Evaluations, and Future Directions

by   Shulei Ji, et al.

The utilization of deep learning techniques in generating various contents (such as image, text, etc.) has become a trend. Especially music, the topic of this paper, has attracted widespread attention of countless researchers.The whole process of producing music can be divided into three stages, corresponding to the three levels of music generation: score generation produces scores, performance generation adds performance characteristics to the scores, and audio generation converts scores with performance characteristics into audio by assigning timbre or generates music in audio format directly. Previous surveys have explored the network models employed in the field of automatic music generation. However, the development history, the model evolution, as well as the pros and cons of same music generation task have not been clearly illustrated. This paper attempts to provide an overview of various composition tasks under different music generation levels, covering most of the currently popular music generation tasks using deep learning. In addition, we summarize the datasets suitable for diverse tasks, discuss the music representations, the evaluation methods as well as the challenges under different levels, and finally point out several future directions.



There are no comments yet.


page 2

page 3

page 15

page 16

page 24

page 34


Personalized Popular Music Generation Using Imitation and Structure

Many practices have been presented in music generation recently. While s...

POP909: A Pop-song Dataset for Music Arrangement Generation

Music arrangement generation is a subtask of automatic music generation,...

Off the Beaten Track: Using Deep Learning to Interpolate Between Music Genres

We describe a system based on deep learning that generates drum patterns...

Dual-track Music Generation using Deep Learning

Music generation is always interesting in a sense that there is no forma...

Shimon the Robot Film Composer and DeepScore: An LSTM for Generation of Film Scores based on Visual Analysis

Composing for a film requires developing an understanding of the film, i...

Deep Learning Techniques for Music Generation

This book is a survey and an analysis of different ways of using deep le...

Analyzing Images for Music Recommendation

Experiencing images with suitable music can greatly enrich the overall u...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.