Optical Gaze Tracking with Spatially-Sparse Single-Pixel Detectors

09/15/2020
by   Richard Li, et al.
0

Gaze tracking is an essential component of next generation displays for virtual reality and augmented reality applications. Traditional camera-based gaze trackers used in next generation displays are known to be lacking in one or multiple of the following metrics: power consumption, cost, computational complexity, estimation accuracy, latency, and form-factor. We propose the use of discrete photodiodes and light-emitting diodes (LEDs) as an alternative to traditional camera-based gaze tracking approaches while taking all of these metrics into consideration. We begin by developing a rendering-based simulation framework for understanding the relationship between light sources and a virtual model eyeball. Findings from this framework are used for the placement of LEDs and photodiodes. Our first prototype uses a neural network to obtain an average error rate of 2.67 at 400Hz while demanding only 16mW. By simplifying the implementation to using only LEDs, duplexed as light transceivers, and more minimal machine learning model, namely a light-weight supervised Gaussian process regression algorithm, we show that our second prototype is capable of an average error rate of 1.57 at 250 Hz using 800 mW.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

research
08/23/2023

Gaze Estimation on Spresense

Gaze estimation is a valuable technology with numerous applications in f...
research
03/18/2020

Gaze-Sensing LEDs for Head Mounted Displays

We introduce a new gaze tracker for Head Mounted Displays (HMDs). We mod...
research
07/04/2022

GazBy: Gaze-Based BERT Model to Incorporate Human Attention in Neural Information Retrieval

This paper is interested in investigating whether human gaze signals can...
research
05/03/2022

Practical Saccade Prediction for Head-Mounted Displays: Towards a Comprehensive Model

Eye-tracking technology is an integral component of new display devices ...
research
02/02/2021

A privacy-preserving approach to streaming eye-tracking data

Eye-tracking technology is being increasingly integrated into mixed real...
research
06/02/2022

EyeCoD: Eye Tracking System Acceleration via FlatCam-based Algorithm Accelerator Co-Design

Eye tracking has become an essential human-machine interaction modality ...
research
05/09/2022

Identifying Fixation and Saccades in Virtual Reality

Gaze recognition can significantly reduce the amount of eye movement dat...

Please sign up or login with your details

Forgot password? Click here to reset