HeadText: Exploring Hands-free Text Entry using Head Gestures by Motion Sensing on a Smart Earpiece

05/20/2022
by   Songlin Xu, et al.
0

We present HeadText, a hands-free technique on a smart earpiece for text entry by motion sensing. Users input text utilizing only 7 head gestures for key selection, word selection, word commitment and word cancelling tasks. Head gesture recognition is supported by motion sensing on a smart earpiece to capture head moving signals and machine learning algorithms (K-Nearest-Neighbor (KNN) with a Dynamic Time Warping (DTW) distance measurement). A 10-participant user study proved that HeadText could recognize 7 head gestures at an accuracy of 94.29 achieve a maximum accuracy of 10.65 WPM and an average accuracy of 9.84 WPM for text entry. Finally, we demonstrate potential applications of HeadText in hands-free scenarios for (a). text entry of people with motor impairments, (b). private text entry, and (c). socially acceptable text entry.

READ FULL TEXT

page 6

page 9

02/24/2021

TeethTap: Recognizing Discrete Teeth Gestures Using Motion and Acoustic Sensing on an Earpiece

Teeth gestures become an alternative input modality for different situat...
05/07/2017

AirDraw: Leveraging Smart Watch Motion Sensors for Mobile Human Computer Interactions

Wearable computing is one of the fastest growing technologies today. Sma...
05/31/2018

Classifying Eyes-Free Mobile Authentication Techniques

Mobile device users avoiding observational attacks and coping with situa...
10/02/2017

Finger Based Techniques for Nonvisual Touchscreen Text Entry

This research proposes Finger Based Technique (FBT) for non-visual touch...
06/16/2021

OESense: Employing Occlusion Effect for In-ear Human Sensing

Smart earbuds are recognized as a new wearable platform for personal-sca...
01/24/2020

Touchless Typing using Head Movement-based Gestures

Physical contact-based typing interfaces are not suitable for people wit...