Moment-to-Moment Detection of Internal Thought from Eye Vergence Behaviour

01/19/2019
by   Michae Xuelin Huang, et al.
0

Internal thought refers to the process of directing attention away from a primary visual task to internal cognitive processing. Internal thought is a pervasive mental activity and closely related to primary task performance. As such, automatic detection of internal thought has significant potential for user modelling in intelligent interfaces, particularly for e-learning applications. Despite the close link between the eyes and the human mind, only a few studies have investigated vergence behaviour during internal thought and none has studied moment-to-moment detection of internal thought from gaze. While prior studies relied on long-term data analysis and required a large number of gaze characteristics, we describe a novel method that is computationally light-weight and that only requires eye vergence information that is readily available from binocular eye trackers. We further propose a novel paradigm to obtain ground truth internal thought annotations that exploits human blur perception. We evaluate our method for three increasingly challenging detection tasks: (1) during a controlled math-solving task, (2) during natural viewing of lecture videos, and (3) during daily activities, such as coding, browsing, and reading. Results from these evaluations demonstrate the performance and robustness of vergence-based detection of internal thought and, as such, open up new directions for research on interfaces that adapt to shifts of mental attention.

READ FULL TEXT
research
12/20/2022

Modeling Human Eye Movements with Neural Networks in a Maze-Solving Task

From smoothly pursuing moving objects to rapidly shifting gazes during v...
research
12/21/2021

A Survey on Using Gaze Behaviour for Natural Language Processing

Gaze behaviour has been used as a way to gather cognitive information fo...
research
01/30/2023

Thought Bubbles: A Proxy into Players' Mental Model Development

Studying mental models has recently received more attention, aiming to u...
research
05/26/2020

Gaze-based Autism Detection for Adolescents and Young Adults using Prosaic Videos

Autism often remains undiagnosed in adolescents and adults. Prior resear...
research
12/15/2021

Cognition-aware Cognate Detection

Automatic detection of cognates helps downstream NLP tasks of Machine Tr...
research
07/05/2016

A probabilistic tour of visual attention and gaze shift computational models

In this paper a number of problems are considered which are related to t...
research
05/25/2020

Happy Are Those Who Grade without Seeing: A Multi-Task Learning Approach to Grade Essays Using Gaze Behaviour

The gaze behaviour of a reader is helpful in solving several NLP tasks s...

Please sign up or login with your details

Forgot password? Click here to reset