An Interpretable and Attention-based Method for Gaze Estimation Using Electroencephalography

08/09/2023
by   Nina Weng, et al.
0

Eye movements can reveal valuable insights into various aspects of human mental processes, physical well-being, and actions. Recently, several datasets have been made available that simultaneously record EEG activity and eye movements. This has triggered the development of various methods to predict gaze direction based on brain activity. However, most of these methods lack interpretability, which limits their technology acceptance. In this paper, we leverage a large data set of simultaneously measured Electroencephalography (EEG) and Eye tracking, proposing an interpretable model for gaze estimation from EEG data. More specifically, we present a novel attention-based deep learning framework for EEG signal analysis, which allows the network to focus on the most relevant information in the signal and discard problematic channels. Additionally, we provide a comprehensive evaluation of the presented framework, demonstrating its superiority over current methods in terms of accuracy and robustness. Finally, the study presents visualizations that explain the results of the analysis and highlights the potential of attention mechanism for improving the efficiency and effectiveness of EEG data analysis in a variety of applications.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/19/2023

Electrode Clustering and Bandpass Analysis of EEG Data for Gaze Estimation

In this study, we validate the findings of previously published papers, ...
research
06/17/2022

A Deep Learning Approach for the Segmentation of Electroencephalography Data in Eye Tracking Applications

The collection of eye gaze information provides a window into many criti...
research
01/04/2022

Exploiting EEG Signals for Eye Motion Tracking

Human eye tracking devices can help to investigate principles of process...
research
11/08/2020

Integrating Human Gaze into Attention for Egocentric Activity Recognition

It is well known that human gaze carries significant information about v...
research
11/06/2021

EEGEyeNet: a Simultaneous Electroencephalography and Eye-tracking Dataset and Benchmark for Eye Movement Prediction

We present a new dataset and benchmark with the goal of advancing resear...
research
05/19/2023

EEG and EMG dataset for the detection of errors introduced by an active orthosis device

This paper presents a dataset containing recordings of the electroenceph...
research
07/27/2023

Tactile Bodily Gaze Mapping Could Regulate Human Attention

Increasing individuals' awareness of their own body signals can lead to ...

Please sign up or login with your details

Forgot password? Click here to reset