Sensing the Breath: A Multimodal Singing Tutoring Interface with Breath Guidance

by   Ziyue Piao, et al.

Breath is a significant component in singing performance, which is still underresearched in most singing-related music interfaces. In this paper, we present a multimodal system that detects the learner's singing pitch and breathing states and provides real-time visual tutoring feedback. Specifically, the breath detector is a wearable belt with pressure sensors and flexible fabric. It monitors real-time body movement of the abdomen, back waist, and twin ribs. A breath visualization algorithm is developed to display real-time breath states, together with the singing pitch contours on an interactive score interface. User studies show that our system can help users not only gain deeper breath during singing but also improve pitch accuracy in vocal training, especially for those with some musical background.




Interactive Rainbow Score: A Visual-centered Multimodal Flute Tutoring System

Learning to play an instrument is intrinsically multimodal, and we have ...

A Technical Framework for Musical Biofeedback in Stroke Rehabilitation

We here present work a generalized low-level technical framework aimed t...

Tiger:Wearable Glasses for the 20-20-20 Rule to Alleviate Computer Vision Syndrome

We propose Tiger, an eyewear system for helping users follow the 20-20-2...

Tumera: Tutor of Photography Beginners

With the popularity of photographic equipment, more and more people are ...

A Directional Vibrotactile Feedback Interface for Ergonomic Postural Adjustment

The objective of this paper is to develop and evaluate a directional vib...

Ghostfinger: a novel platform for fully computational fingertip controllers

We present Ghostfinger, a technology for highly dynamic up/down fingerti...

Adaptive Multimodal Music Learning via Interactive-haptic Instrument

Haptic interfaces have untapped the sense of touch to assist multimodal ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.