RoboJam: A Musical Mixture Density Network for Collaborative Touchscreen Interaction

11/29/2017
by   Charles P. Martin, et al.
0

RoboJam is a machine-learning system for generating music that assists users of a touchscreen music app by performing responses to their short improvisations. This system uses a recurrent artificial neural network to generate sequences of touchscreen interactions and absolute timings, rather than high-level musical notes. To accomplish this, RoboJam's network uses a mixture density layer to predict appropriate touch interaction locations in space and time. In this paper, we describe the design and implementation of RoboJam's network and how it has been integrated into a touchscreen music app. A preliminary evaluation analyses the system in terms of training, musical generation and user interaction.

READ FULL TEXT

page 2

page 6

page 8

research
04/10/2019

An Interactive Musical Prediction System with Mixture Density Recurrent Neural Networks

This paper is about creating digital musical instruments where a predict...
research
12/03/2020

A Laptop Ensemble Performance System using Recurrent Neural Networks

The popularity of applying machine learning techniques in musical domain...
research
08/31/2022

A Musical Serious Game for Social Interaction through Augmented Rhythmic Improvisation

Making music with other people is a social activity as well as an artist...
research
02/02/2019

Data Driven Analysis of Tiny Touchscreen Performance with MicroJam

The widespread adoption of mobile devices, such as smartphones and table...
research
06/22/2018

A Predictive Model for Music Based on Learned Interval Representations

Connectionist sequence models (e.g., RNNs) applied to musical sequences ...
research
11/20/2019

Moving to Communicate, Moving to Interact: Patterns of Body Motion in Musical Duo Performance

Skilled ensemble musicians coordinate with high precision, even when imp...
research
02/16/2023

Mixing Levels – A Rock Music Spirit Level App

To date, sonification apps are rare. Music apps on the other hand are wi...

Please sign up or login with your details

Forgot password? Click here to reset