Adaptive Multimodal Music Learning via Interactive-haptic Instrument

06/04/2019
by   Yian Zhang, et al.
0

Haptic interfaces have untapped the sense of touch to assist multimodal music learning. We have recently seen various improvements of interface design on tactile feedback and force guidance aiming to make instrument learning more effective. However, most interfaces are still quite static; they cannot yet sense the learning progress and adjust the tutoring strategy accordingly. To solve this problem, we contribute an adaptive haptic interface based on the latest design of haptic flute. We first adopted a clutch mechanism to enable the interface to turn on and off the haptic control flexibly in real time. The interactive tutor is then able to follow human performances and apply the "teacher force" only when the software instructs so. Finally, we incorporated the adaptive interface with a step-by-step dynamic learning strategy. Experimental results showed that dynamic learning dramatically outperforms static learning, which boosts the learning rate by 45.3 forgetting chance by 86

READ FULL TEXT

page 2

page 5

page 6

research
04/29/2020

Interactive Rainbow Score: A Visual-centered Multimodal Flute Tutoring System

Learning to play an instrument is intrinsically multimodal, and we have ...
research
03/18/2018

ShIFT: A Semi-haptic Interface for Flute Tutoring

Traditional instrument learning is time-consuming. It begins with learni...
research
10/08/2020

interface : Electronic Chamber Ensemble

This paper presents the interface developments and music of the duo "int...
research
02/03/2022

Sensing the Breath: A Multimodal Singing Tutoring Interface with Breath Guidance

Breath is a significant component in singing performance, which is still...
research
03/23/2022

An interactive music infilling interface for pop music composition

Artificial intelligence (AI) has been widely applied to music generation...
research
02/22/2022

Shape-Haptics: Planar Passive Force Feedback Mechanisms for Physical Interfaces

We present Shape-Haptics, an approach for designers to rapidly design an...
research
09/14/2020

Play Music An HCI Oriented Evaluation of Googles Default Music Player Interface

The work embodied in this paper attempts to suggest a few improvements t...

Please sign up or login with your details

Forgot password? Click here to reset