CycleDRUMS: Automatic Drum Arrangement For Bass Lines Using CycleGAN

04/01/2021
by   Giorgio Barnabo, et al.
0

The two main research threads in computer-based music generation are: the construction of autonomous music-making systems, and the design of computer-based environments to assist musicians. In the symbolic domain, the key problem of automatically arranging a piece music was extensively studied, while relatively fewer systems tackled this challenge in the audio domain. In this contribution, we propose CycleDRUMS, a novel method for generating drums given a bass line. After converting the waveform of the bass into a mel-spectrogram, we are able to automatically generate original drums that follow the beat, sound credible and can be directly mixed with the input bass. We formulated this task as an unpaired image-to-image translation problem, and we addressed it with CycleGAN, a well-established unsupervised style transfer framework, originally designed for treating images. The choice to deploy raw audio and mel-spectrograms enabled us to better represent how humans perceive music, and to potentially draw sounds for new arrangements from the vast collection of music recordings accumulated in the last century. In absence of an objective way of evaluating the output of both generative adversarial networks and music generative systems, we further defined a possible metric for the proposed task, partially based on human (and expert) judgement. Finally, as a comparison, we replicated our results with Pix2Pix, a paired image-to-image translation network, and we showed that our approach outperforms it.

READ FULL TEXT
research
11/28/2018

Play as You Like: Timbre-enhanced Multi-modal Music Style Transfer

Style transfer of polyphonic music recordings is a challenging task when...
research
04/28/2022

Music Enhancement via Image Translation and Vocoding

Consumer-grade music recordings such as those captured by mobile devices...
research
09/20/2018

Symbolic Music Genre Transfer with CycleGAN

Deep generative models such as Variational Autoencoders (VAEs) and Gener...
research
09/17/2020

Crossing You in Style: Cross-modal Style Transfer from Music to Visual Arts

Music-to-visual style transfer is a challenging yet important cross-moda...
research
07/04/2019

Supervised Symbolic Music Style Translation Using Synthetic Data

Research on style transfer and domain translation has clearly demonstrat...
research
11/22/2019

GANkyoku: a Generative Adversarial Network for Shakuhachi Music

A common approach to generating symbolic music using neural networks inv...
research
07/29/2020

Improved Handling of Repeats and Jumps in Audio-Sheet Image Synchronization

This paper studies the problem of automatically generating piano score f...

Please sign up or login with your details

Forgot password? Click here to reset