Setting the rhythm scene: deep learning-based drum loop generation from arbitrary language cues

09/20/2022
by   Ignacio J. Tripodi, et al.
0

Generative artificial intelligence models can be a valuable aid to music composition and live performance, both to aid the professional musician and to help democratize the music creation process for hobbyists. Here we present a novel method that, given an English word or phrase, generates 2 compasses of a 4-piece drum pattern that embodies the "mood" of the given language cue, or that could be used for an audiovisual scene described by the language cue. We envision this tool as composition aid for electronic music and audiovisual soundtrack production, or an improvisation tool for live performance. In order to produce the training samples for this model, besides manual annotation of the "scene" or "mood" terms, we have designed a novel method to extract the consensus drum track of any song. This consists of a 2-bar, 4-piece drum pattern that represents the main percussive motif of a song, which could be imported into any music loop device or live looping software. These two key components (drum pattern generation from a generalizable input, and consensus percussion extraction) present a novel approach to computer-aided composition and provide a stepping stone for more comprehensive rhythm generation.

READ FULL TEXT
research
04/01/2020

Towards democratizing music production with AI-Design of Variational Autoencoder-based Rhythm Generator as a DAW plugin

There has been significant progress in the music generation technique ut...
research
04/25/2018

Off the Beaten Track: Using Deep Learning to Interpolate Between Music Genres

We describe a system based on deep learning that generates drum patterns...
research
10/06/2019

Liveness in Interactive Systems

Creating an artifact in front of public offers an opportunity to involve...
research
10/19/2019

Automated Composition of Picture-Synched Music Soundtracks for Movies

We describe the implementation of and early results from a system that a...
research
07/10/2019

Learning from History: Recreating and Repurposing Sister Harriet Padberg's Computer Composed Canon and Free Fugue

Harriet Padberg wrote Computer-Composed Canon and Free Fugue as part of ...
research
08/26/2020

The Freesound Loop Dataset and Annotation Tool

Music loops are essential ingredients in electronic music production, an...

Please sign up or login with your details

Forgot password? Click here to reset