RIT-Eyes: Rendering of near-eye images for eye-tracking applications

06/05/2020
by   Nitinraj Nair, et al.
5

Deep neural networks for video-based eye tracking have demonstrated resilience to noisy environments, stray reflections, and low resolution. However, to train these networks, a large number of manually annotated images are required. To alleviate the cumbersome process of manual labeling, computer graphics rendering is employed to automatically generate a large corpus of annotated eye images under various conditions. In this work, we introduce a synthetic eye image generation platform that improves upon previous work by adding features such as an active deformable iris, an aspherical cornea, retinal retro-reflection, gaze-coordinated eye-lid deformations, and blinks. To demonstrate the utility of our platform, we render images reflecting the represented gaze distributions inherent in two publicly available datasets, NVGaze and OpenEDS. We also report on the performance of two semantic segmentation architectures (SegNet and RITnet) trained on rendered images and tested on the original datasets.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

research
10/01/2019

RITnet: Real-time Semantic Segmentation of the Eye for Gaze Tracking

Accurate eye segmentation can improve eye-gaze estimation and support in...
research
12/02/2020

Dataset for Eye-Tracking Tasks

In recent years many different deep neural networks were developed, but ...
research
09/12/2023

LEyes: A Lightweight Framework for Deep Learning-Based Eye Tracking using Synthetic Eye Images

Deep learning has bolstered gaze estimation techniques, but real-world d...
research
02/06/2022

On Smart Gaze based Annotation of Histopathology Images for Training of Deep Convolutional Neural Networks

Unavailability of large training datasets is a bottleneck that needs to ...
research
07/19/2020

EllSeg: An Ellipse Segmentation Framework for Robust Gaze Tracking

Ellipse fitting, an essential component in pupil or iris tracking based ...
research
09/03/2019

Towards Making a Dependency Parser See

We explore whether it is possible to leverage eye-tracking data in an RN...
research
05/04/2022

EllSeg-Gen, towards Domain Generalization for head-mounted eyetracking

The study of human gaze behavior in natural contexts requires algorithms...

Please sign up or login with your details

Forgot password? Click here to reset