Tracking Ensemble Performance on Touch-Screens with Gesture Classification and Transition Matrices

12/01/2020
by   Charles Martin, et al.
0

We present and evaluate a novel interface for tracking ensemble performances on touch-screens. The system uses a Random Forest classifier to extract touch-screen gestures and transition matrix statistics. It analyses the resulting gesture-state sequences across an ensemble of performers. A series of specially designed iPad apps respond to this real-time analysis of free-form gestural performances with calculated modifications to their musical interfaces. We describe our system and evaluate it through cross-validation and profiling as well as concert experience.

READ FULL TEXT

page 1

page 4

research
11/10/2019

A Dynamic Modelling Framework for Human Hand Gesture Task Recognition

Gesture recognition and hand motion tracking are important tasks in adva...
research
04/25/2021

Comparing Hand Gestures and the Gamepad Interfaces for Locomotion in Virtual Environments

Hand gesture is a new and promising interface for locomotion in virtual ...
research
06/22/2022

Real-Time Online Skeleton Extraction and Gesture Recognition on Pepper

We present a multi-stage pipeline for simple gesture recognition. The no...
research
09/14/2019

Progression Modelling for Online and Early Gesture Detection

Online and Early detection of gestures is crucial for building touchless...
research
03/08/2017

Fast Gesture Recognition with Multiple Stream Discrete HMMs on 3D Skeletons

HMMs are widely used in action and gesture recognition due to their impl...
research
07/01/2021

iMiGUE: An Identity-free Video Dataset for Micro-Gesture Understanding and Emotion Analysis

We introduce a new dataset for the emotional artificial intelligence res...
research
12/01/2020

Cross-artform performance using networked interfaces: Last Man to Die's Vital LMTD

In 2009 the cross artform group, Last Man to Die, presented a series of ...

Please sign up or login with your details

Forgot password? Click here to reset