The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-composed Music through Quantitative Measures

by   Shih-Lun Wu, et al.
Academia Sinica
National Taiwan University

This paper presents the Jazz Transformer, a generative model that utilizes a neural sequence model called the Transformer-XL for modeling lead sheets of Jazz music. Moreover, the model endeavors to incorporate structural events present in the Weimar Jazz Database (WJazzD) for inducing structures in the generated music. While we are able to reduce the training loss to a low value, our listening test suggests however a clear gap between the average ratings of the generated and real compositions. We therefore go one step further and conduct a series of computational analysis of the generated compositions from different perspectives. This includes analyzing the statistics of the pitch class, grooving, and chord progression, assessing the structureness of the music with the help of the fitness scape plot, and evaluating the model's understanding of Jazz music through a MIREX-like continuation prediction task. Our work presents in an analytical manner why machine-generated music to date still falls short of the artwork of humanity, and sets some goals for future work on automatic composition to further pursue.


page 1

page 2

page 3

page 4


Pop Music Transformer: Generating Music with Rhythm and Harmony

The task automatic music composition entails generative modeling of musi...

Choir Transformer: Generating Polyphonic Music with Relative Attention on Transformer

Polyphonic music generation is still a challenge direction due to its co...

Automatic Composition of Guitar Tabs by Transformers and Groove Modeling

Deep learning algorithms are increasingly developed for learning to comp...

Multi-Genre Music Transformer – Composing Full Length Musical Piece

In the task of generating music, the art factor plays a big role and is ...

Generative Deep Learning for Virtuosic Classical Music: Generative Adversarial Networks as Renowned Composers

Current AI-generated music lacks fundamental principles of good composit...

A Transformer Based Pitch Sequence Autoencoder with MIDI Augmentation

Algorithms based on deep learning have been widely put forward for autom...

Exploring Transformer's potential on automatic piano transcription

Most recent research about automatic music transcription (AMT) uses conv...

Please sign up or login with your details

Forgot password? Click here to reset