Adaptive Multimodal Music Learning via Interactive-haptic Instrument

by   Yian Zhang, et al.

Haptic interfaces have untapped the sense of touch to assist multimodal music learning. We have recently seen various improvements of interface design on tactile feedback and force guidance aiming to make instrument learning more effective. However, most interfaces are still quite static; they cannot yet sense the learning progress and adjust the tutoring strategy accordingly. To solve this problem, we contribute an adaptive haptic interface based on the latest design of haptic flute. We first adopted a clutch mechanism to enable the interface to turn on and off the haptic control flexibly in real time. The interactive tutor is then able to follow human performances and apply the "teacher force" only when the software instructs so. Finally, we incorporated the adaptive interface with a step-by-step dynamic learning strategy. Experimental results showed that dynamic learning dramatically outperforms static learning, which boosts the learning rate by 45.3 forgetting chance by 86



There are no comments yet.


page 2

page 5

page 6


Interactive Rainbow Score: A Visual-centered Multimodal Flute Tutoring System

Learning to play an instrument is intrinsically multimodal, and we have ...

ShIFT: A Semi-haptic Interface for Flute Tutoring

Traditional instrument learning is time-consuming. It begins with learni...

interface : Electronic Chamber Ensemble

This paper presents the interface developments and music of the duo "int...

The MATRIX: A Novel Controller for Musical Expression

The MATRIX (Multipurpose Array of Tactile Rods for Interactive eXpressio...

A Generic Framework and Library for Exploration of Small Multiples through Interactive Piling

Small multiples are miniature representations of visual information used...

The Accordiatron: A MIDI Controller For Interactive Music

The Accordiatron is a new MIDI controller for real-time performance base...

Personal applications, based on moveable / resizable elements

All the modern day applications have the interface, absolutely defined b...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.