Interactive Machine Learning of Musical Gesture

11/26/2020
by   Federico Ghelli Visi, et al.
0

This chapter presents an overview of Interactive Machine Learning (IML) techniques applied to the analysis and design of musical gestures. We go through the main challenges and needs related to capturing, analysing, and applying IML techniques to human bodily gestures with the purpose of performing with sound synthesis systems. We discuss how different algorithms may be used to accomplish different tasks, including interacting with complex synthesis techniques and exploring interaction possibilities by means of Reinforcement Learning (RL) in an interaction paradigm we developed called Assisted Interactive Machine Learning (AIML). We conclude the chapter with a description of how some of these techniques were employed by the authors for the development of four musical pieces, thus outlining the implications that IML have for musical practice.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/07/2020

Sonification of Facial Actions for Musical Expression

The central role of the face in social interaction and non-verbal commun...
research
10/04/2020

The MATRIX: A Novel Controller for Musical Expression

The MATRIX (Multipurpose Array of Tactile Rods for Interactive eXpressio...
research
02/11/2019

A Minimal Template for Interactive Web-based Demonstrations of Musical Machine Learning

New machine learning algorithms are being developed to solve problems in...
research
07/11/2023

SnakeSynth: New Interactions for Generative Audio Synthesis

I present "SnakeSynth," a web-based lightweight audio synthesizer that c...
research
03/02/2023

AI as mediator between composers, sound designers, and creative media producers

Musical professionals who produce material for non-musical stakeholders ...
research
06/18/2015

Emergence of synchrony in an Adaptive Interaction Model

In a Human-Computer Interaction context, we aim to elaborate an adaptive...
research
05/18/2010

Dynamical issues in interactive representation of physical objects

The quality of a simulator equipped with a haptic interface is given by ...

Please sign up or login with your details

Forgot password? Click here to reset