Bayesian Eye Tracking

06/25/2021
by   Qiang Ji, et al.
0

Model-based eye tracking has been a dominant approach for eye gaze tracking because of its ability to generalize to different subjects, without the need of any training data and eye gaze annotations. Model-based eye tracking, however, is susceptible to eye feature detection errors, in particular for eye tracking in the wild. To address this issue, we propose a Bayesian framework for model-based eye tracking. The proposed system consists of a cascade-Bayesian Convolutional Neural Network (c-BCNN) to capture the probabilistic relationships between eye appearance and its landmarks, and a geometric eye model to estimate eye gaze from the eye landmarks. Given a testing eye image, the Bayesian framework can generate, through Bayesian inference, the eye gaze distribution without explicit landmark detection and model training, based on which it not only estimates the most likely eye gaze but also its uncertainty. Furthermore, with Bayesian inference instead of point-based inference, our model can not only generalize better to different sub-jects, head poses, and environments but also is robust to image noise and landmark detection errors. Finally, with the estimated gaze uncertainty, we can construct a cascade architecture that allows us to progressively improve gaze estimation accuracy. Compared to state-of-the-art model-based and learning-based methods, the proposed Bayesian framework demonstrates significant improvement in generalization capability across several benchmark datasets and in accuracy and robustness under challenging real-world conditions.

READ FULL TEXT

page 6

page 8

research
01/30/2019

Evaluation of Appearance-Based Methods and Implications for Gaze-Based Applications

Appearance-based gaze estimation methods that only require an off-the-sh...
research
05/12/2018

Learning to Find Eye Region Landmarks for Remote Gaze Estimation in Unconstrained Settings

Conventional feature-based and model-based gaze estimation methods have ...
research
11/15/2017

Robust Real-Time Multi-View Eye Tracking

Despite significant advances in improving the gaze estimation accuracy u...
research
10/10/2021

FLAME: Facial Landmark Heatmap Activated Multimodal Gaze Estimation

3D gaze estimation is about predicting the line of sight of a person in ...
research
06/02/2022

RELAY: Robotic EyeLink AnalYsis of the EyeLink 1000 using an Artificial Eye

There is a widespread assumption that the peak velocities of visually gu...
research
03/13/2020

A Neural Architecture for Detecting Confusion in Eye-tracking Data

Encouraged by the success of deep learning in a variety of domains, we i...
research
09/02/2019

Combining Deep Learning and Model-Based Methods for Robust Real-Time Semantic Landmark Detection

Compared to abstract features, significant objects, so-called landmarks,...

Please sign up or login with your details

Forgot password? Click here to reset