Interactive Rainbow Score: A Visual-centered Multimodal Flute Tutoring System

by   Daniel Chin, et al.

Learning to play an instrument is intrinsically multimodal, and we have seen a trend of applying visual and haptic feedback in music games and computer-aided music tutoring systems. However, most current systems are still designed to master individual pieces of music; it is unclear how well the learned skills can be generalized to new pieces. We aim to explore this question. In this study, we contribute Interactive Rainbow Score, an interactive visual system to boost the learning of sight-playing, the general musical skill to read music and map the visual representations to performance motions. The key design of Interactive Rainbow Score is to associate pitches (and the corresponding motions) with colored notation and further strengthen such association via real-time interactions. Quantitative results show that the interactive feature on average increases the learning efficiency by 31.1 Further analysis indicates that it is critical to apply the interaction in the early period of learning.



There are no comments yet.


page 2

page 3


Autonomy in the interactive music system VIVO

Interactive Music Systems (IMS) have introduced a new world of music-mak...

Adaptive Multimodal Music Learning via Interactive-haptic Instrument

Haptic interfaces have untapped the sense of touch to assist multimodal ...

Sensing the Breath: A Multimodal Singing Tutoring Interface with Breath Guidance

Breath is a significant component in singing performance, which is still...

Ride N' Rhythm, Bike as an Embodied Musical Instrument to Improve Music Perception for Young Children

Music plays a crucial role in young children's development. Current rese...

The Accordiatron: A MIDI Controller For Interactive Music

The Accordiatron is a new MIDI controller for real-time performance base...

The Interactive Dance Club: Avoiding Chaos In A Multi Participant Environment

In 1998 we designed enabling technology and a venue concept that allowed...

ChoreoNet: Towards Music to Dance Synthesis with Choreographic Action Unit

Dance and music are two highly correlated artistic forms. Synthesizing d...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.