EllSeg-Gen, towards Domain Generalization for head-mounted eyetracking

05/04/2022
by   Rakshit S. Kothari, et al.
0

The study of human gaze behavior in natural contexts requires algorithms for gaze estimation that are robust to a wide range of imaging conditions. However, algorithms often fail to identify features such as the iris and pupil centroid in the presence of reflective artifacts and occlusions. Previous work has shown that convolutional networks excel at extracting gaze features despite the presence of such artifacts. However, these networks often perform poorly on data unseen during training. This work follows the intuition that jointly training a convolutional network with multiple datasets learns a generalized representation of eye parts. We compare the performance of a single model trained with multiple datasets against a pool of models trained on individual datasets. Results indicate that models tested on datasets in which eye images exhibit higher appearance variability benefit from multiset training. In contrast, dataset-specific models generalize better onto eye images with lower appearance variability.

READ FULL TEXT

page 1

page 14

page 26

research
03/18/2019

Appearance-Based Gaze Estimation Using Dilated-Convolutions

Appearance-based gaze estimation has attracted more and more attention b...
research
06/18/2022

Multistream Gaze Estimation with Anatomical Eye Region Isolation by Synthetic to Real Transfer Learning

We propose a novel neural pipeline, MSGazeNet, that learns gaze represen...
research
11/23/2021

HybridGazeNet: Geometric model guided Convolutional Neural Networks for gaze estimation

As a critical cue for understanding human intention, human gaze provides...
research
05/24/2022

Partial-input baselines show that NLI models can ignore context, but they don't

When strong partial-input baselines reveal artifacts in crowdsourced NLI...
research
06/05/2020

RIT-Eyes: Rendering of near-eye images for eye-tracking applications

Deep neural networks for video-based eye tracking have demonstrated resi...
research
09/06/2023

The Quiet Eye Phenomenon in Minimally Invasive Surgery

In this paper, we report our discovery of a gaze behavior called Quiet E...

Please sign up or login with your details

Forgot password? Click here to reset