TeethTap: Recognizing Discrete Teeth Gestures Using Motion and Acoustic Sensing on an Earpiece

02/24/2021
by   Wei Sun, et al.
0

Teeth gestures become an alternative input modality for different situations and accessibility purposes. In this paper, we present TeethTap, a novel eyes-free and hands-free input technique, which can recognize up to 13 discrete teeth tapping gestures. TeethTap adopts a wearable 3D printed earpiece with an IMU sensor and a contact microphone behind both ears, which works in tandem to detect jaw movement and sound data, respectively. TeethTap uses a support vector machine to classify gestures from noise by fusing acoustic and motion data, and implements K-Nearest-Neighbor (KNN) with a Dynamic Time Warping (DTW) distance measurement using motion data for gesture classification. A user study with 11 participants demonstrated that TeethTap could recognize 13 gestures with a real-time classification accuracy of 90.9 We further uncovered the accuracy differences on different teeth gestures when having sensors on single vs. both sides. Moreover, we explored the activation gesture under real-world environments, including eating, speaking, walking and jumping. Based on our findings, we further discussed potential applications and practical challenges of integrating TeethTap into future devices.

READ FULL TEXT

Authors

page 6

page 8

page 10

05/20/2022

HeadText: Exploring Hands-free Text Entry using Head Gestures by Motion Sensing on a Smart Earpiece

We present HeadText, a hands-free technique on a smart earpiece for text...
12/11/2021

Acoustic Sensing-based Hand Gesture Detection for Wearable Device Interaction

Hand gesture recognition attracts great attention for interaction since ...
06/02/2021

Understanding the Design Space of Mouth Microgestures

As wearable devices move toward the face (i.e. smart earbuds, glasses), ...
03/15/2019

GestureKeeper: Gesture Recognition for Controlling Devices in IoT Environments

This paper introduces and evaluates the GestureKeeper, a robust hand-ges...
09/10/2018

Does Your Phone Know Your Touch?

This paper explores supervised techniques for continuous anomaly detecti...
08/26/2020

Deep learning-based computer vision to recognize and classify suturing gestures in robot-assisted surgery

Our previous work classified a taxonomy of suturing gestures during a ve...
01/09/2014

Gesture recognition based mouse events

This paper presents the maneuver of mouse pointer and performs various m...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.