A Laptop Ensemble Performance System using Recurrent Neural Networks

12/03/2020
by   Rohan Proctor, et al.
0

The popularity of applying machine learning techniques in musical domains has created an inherent availability of freely accessible pre-trained neural network (NN) models ready for use in creative applications. This work outlines the implementation of one such application in the form of an assistance tool designed for live improvisational performances by laptop ensembles. The primary intention was to leverage off-the-shelf pre-trained NN models as a basis for assisting individual performers either as musical novices looking to engage with more experienced performers or as a tool to expand musical possibilities through new forms of creative expression. The system expands upon a variety of ideas found in different research areas including new interfaces for musical expression, generative music and group performance to produce a networked performance solution served via a web-browser interface. The final implementation of the system offers performers a mixture of high and low-level controls to influence the shape of sequences of notes output by locally run NN models in real time, also allowing performers to define their level of engagement with the assisting generative models. Two test performances were played, with the system shown to feasibly support four performers over a four minute piece while producing musically cohesive and engaging music. Iterations on the design of the system exposed technical constraints on the use of a JavaScript environment for generative models in a live music context, largely derived from inescapable processing overheads.

READ FULL TEXT

page 1

page 3

page 5

research
11/29/2017

RoboJam: A Musical Mixture Density Network for Collaborative Touchscreen Interaction

RoboJam is a machine-learning system for generating music that assists u...
research
03/03/2023

LooperGP: A Loopable Sequence Model for Live Coding Performance using GuitarPro Tablature

Despite their impressive offline results, deep learning models for symbo...
research
01/31/2018

Deep Predictive Models in Interactive Music

Automatic music generation is a compelling task where much recent progre...
research
12/02/2020

Enacting Musical Worlds: Common Approaches to using NIMEs within Performance and Person-Centred Arts Practices

Live music making can be understood as an enactive process, whereby musi...
research
02/11/2019

A Minimal Template for Interactive Web-based Demonstrations of Musical Machine Learning

New machine learning algorithms are being developed to solve problems in...
research
11/20/2018

Coupled Recurrent Models for Polyphonic Music Composition

This work describes a novel recurrent model for music composition, which...
research
05/14/2019

Learning to Groove with Inverse Sequence Transformations

We explore models for translating abstract musical ideas (scores, rhythm...

Please sign up or login with your details

Forgot password? Click here to reset