Fine-grained Finger Gesture Recognition Using WiFi Signals

06/01/2021
by   Sheng Tan, et al.
0

Gesture recognition has become increasingly important in human-computer interaction and can support different applications such as smart home, VR, and gaming. Traditional approaches usually rely on dedicated sensors that are worn by the user or cameras that require line of sight. In this paper, we present fine-grained finger gesture recognition by using commodity WiFi without requiring user to wear any sensors. Our system takes advantages of the fine-grained Channel State Information available from commodity WiFi devices and the prevalence of WiFi network infrastructures. It senses and identifies subtle movements of finger gestures by examining the unique patterns exhibited in the detailed CSI. We devise environmental noise removal mechanism to mitigate the effect of signal dynamic due to the environment changes. Moreover, we propose to capture the intrinsic gesture behavior to deal with individual diversity and gesture inconsistency. Lastly, we utilize multiple WiFi links and larger bandwidth at 5GHz to achieve finger gesture recognition under multi-user scenario. Our experimental evaluation in different environments demonstrates that our system can achieve over 90 environment changes and individual diversity. Results also show that our system can provide accurate gesture recognition under different scenarios.

READ FULL TEXT

page 3

page 8

page 9

page 11

page 12

10/26/2018

Online Human Gesture Recognition using Recurrent Neural Networks and Wearable Sensors

Gestures are a natural communication modality for humans. The ability to...
11/11/2021

Towards Domain-Independent and Real-Time Gesture Recognition Using mmWave Signal

Human gesture recognition using millimeter wave (mmWave) signals provide...
05/16/2017

Static Gesture Recognition using Leap Motion

In this report, an automated bartender system was developed for making o...
04/08/2020

Adversary Helps: Gradient-based Device-Free Domain-Independent Gesture Recognition

Wireless signal-based gesture recognition has promoted the developments ...
11/13/2020

CentiTrack: Towards Centimeter-Level Passive Gesture Tracking with Commodity WiFi

Gesture awareness plays a crucial role in promoting human-computer inter...
09/21/2022

AirFi: Empowering WiFi-based Passive Human Gesture Recognition to Unseen Environment via Domain Generalization

WiFi-based smart human sensing technology enabled by Channel State Infor...
09/07/2021

Fine-grained Hand Gesture Recognition in Multi-viewpoint Hand Hygiene

This paper contributes a new high-quality dataset for hand gesture recog...