Optical Gaze Tracking with Spatially-Sparse Single-Pixel Detectors

by   Richard Li, et al.

Gaze tracking is an essential component of next generation displays for virtual reality and augmented reality applications. Traditional camera-based gaze trackers used in next generation displays are known to be lacking in one or multiple of the following metrics: power consumption, cost, computational complexity, estimation accuracy, latency, and form-factor. We propose the use of discrete photodiodes and light-emitting diodes (LEDs) as an alternative to traditional camera-based gaze tracking approaches while taking all of these metrics into consideration. We begin by developing a rendering-based simulation framework for understanding the relationship between light sources and a virtual model eyeball. Findings from this framework are used for the placement of LEDs and photodiodes. Our first prototype uses a neural network to obtain an average error rate of 2.67 at 400Hz while demanding only 16mW. By simplifying the implementation to using only LEDs, duplexed as light transceivers, and more minimal machine learning model, namely a light-weight supervised Gaussian process regression algorithm, we show that our second prototype is capable of an average error rate of 1.57 at 250 Hz using 800 mW.


page 1

page 3

page 4

page 5

page 6

page 7


Gaze-Sensing LEDs for Head Mounted Displays

We introduce a new gaze tracker for Head Mounted Displays (HMDs). We mod...

Would Gaze-Contingent Rendering Improve Depth Perception in Virtual and Augmented Reality?

Near distances are overestimated in virtual reality, and far distances a...

GazBy: Gaze-Based BERT Model to Incorporate Human Attention in Neural Information Retrieval

This paper is interested in investigating whether human gaze signals can...

Practical Saccade Prediction for Head-Mounted Displays: Towards a Comprehensive Model

Eye-tracking technology is an integral component of new display devices ...

A privacy-preserving approach to streaming eye-tracking data

Eye-tracking technology is being increasingly integrated into mixed real...

EyeCoD: Eye Tracking System Acceleration via FlatCam-based Algorithm Accelerator Co-Design

Eye tracking has become an essential human-machine interaction modality ...