Gaze Gestures and Their Applications in human-computer interaction with a head-mounted display

10/16/2019
by   W. X. Chen, et al.
9

A head-mounted display (HMD) is a portable and interactive display device. With the development of 5G technology, it may become a general-purpose computing platform in the future. Human-computer interaction (HCI) technology for HMDs has also been of significant interest in recent years. In addition to tracking gestures and speech, tracking human eyes as a means of interaction is highly effective. In this paper, we propose two UnityEyes-based convolutional neural network models, UEGazeNet and UEGazeNet*, which can be used for input images with low resolution and high resolution, respectively. These models can perform rapid interactions by classifying gaze trajectories (GTs), and a GTgestures dataset containing data for 10,200 "eye-painting gestures" collected from 15 individuals is established with our gaze-tracking method. We evaluated the performance both indoors and outdoors and the UEGazeNet can obtaine results 52% and 67% better than those of state-of-the-art networks. The generalizability of our GTgestures dataset using a variety of gaze-tracking models is evaluated, and an average recognition rate of 96.71% is obtained by our method.

READ FULL TEXT

page 3

page 4

page 5

page 6

page 7

page 8

page 11

research
10/20/2022

Slippage-robust Gaze Tracking for Near-eye Display

In recent years, head-mounted near-eye display devices have become the k...
research
05/03/2019

Toward Standardized Classification of Foveated Displays

Emergent in the field of head mounted display design is a desire to leve...
research
01/31/2022

Beyond synchronization: Body gestures and gaze direction in duo performance

In this chapter, we focus on two main categories of visual interaction: ...
research
11/19/2020

Experimenting Touchless Gestural Interaction for a University Public Web-based Display

Interest in and development of touchless gestural interfaces has recentl...
research
01/26/2023

MoPeDT: A Modular Head-Mounted Display Toolkit to Conduct Peripheral Vision Research

Peripheral vision plays a significant role in human perception and orien...
research
06/09/2021

An Efficient Point of Gaze Estimator for Low-Resolution Imaging Systems Using Extracted Ocular Features Based Neural Architecture

A user's eyes provide means for Human Computer Interaction (HCI) researc...
research
12/06/2022

Towards Energy Efficient Mobile Eye Tracking for AR Glasses through Optical Sensor Technology

After the introduction of smartphones and smartwatches, AR glasses are c...

Please sign up or login with your details

Forgot password? Click here to reset