Fully Convolutional Neural Networks for Raw Eye Tracking Data Segmentation, Generation, and Reconstruction

02/17/2020
by   Wolfgang Fuhl, et al.
0

In this paper, we use fully convolutional neural networks for the semantic segmentation of eye tracking data. We also use these networks for reconstruction, and in conjunction with a variational auto-encoder to generate eye movement data. The first improvement of our approach is that no input window is necessary, due to the use of fully convolutional networks and therefore any input size can be processed directly. The second improvement is that the used and generated data is raw eye tracking data (position X, Y and time) without preprocessing. This is achieved by pre-initializing the filters in the first layer and by building the input tensor along the z axis. We evaluated our approach on three publicly available datasets and compare the results to the state of the art.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/20/2016

Fully Convolutional Networks for Semantic Segmentation

Convolutional networks are powerful visual models that yield hierarchies...
research
01/19/2016

PupilNet: Convolutional Neural Networks for Robust Pupil Detection

Real-time, accurate, and robust pupil detection is an essential prerequi...
research
11/25/2022

On the Universal Approximation Property of Deep Fully Convolutional Neural Networks

We study the approximation of shift-invariant or equivariant functions b...
research
12/02/2020

Dataset for Eye-Tracking Tasks

In recent years many different deep neural networks were developed, but ...
research
08/05/2019

Part Segmentation for Highly Accurate Deformable Tracking in Occlusions via Fully Convolutional Neural Networks

Successfully tracking the human body is an important perceptual challeng...
research
03/20/2022

Fully Convolutional Fractional Scaling

We introduce a fully convolutional fractional scaling component, FCFS. F...
research
10/08/2019

Eyenet: Attention based Convolutional Encoder-Decoder Network for Eye Region Segmentation

With the immersive development in the field of augmented and virtual rea...

Please sign up or login with your details

Forgot password? Click here to reset