DeepAI AI Chat
Log In Sign Up

Modeling Human Eye Movements with Neural Networks in a Maze-Solving Task

by   Jason Li, et al.
Boston University

From smoothly pursuing moving objects to rapidly shifting gazes during visual search, humans employ a wide variety of eye movement strategies in different contexts. While eye movements provide a rich window into mental processes, building generative models of eye movements is notoriously difficult, and to date the computational objectives guiding eye movements remain largely a mystery. In this work, we tackled these problems in the context of a canonical spatial planning task, maze-solving. We collected eye movement data from human subjects and built deep generative models of eye movements using a novel differentiable architecture for gaze fixations and gaze shifts. We found that human eye movements are best predicted by a model that is optimized not to perform the task as efficiently as possible but instead to run an internal simulation of an object traversing the maze. This not only provides a generative model of eye movements in this task but also suggests a computational theory for how humans solve the task, namely that humans use mental simulation.


page 2

page 6


Discriminative Viewer Identification using Generative Models of Eye Gaze

We study the problem of identifying viewers of arbitrary images based on...

Task Classification Model for Visual Fixation, Exploration, and Search

Yarbus' claim to decode the observer's task from eye movements has recei...

Advanced statistical methods for eye movement analysis and modeling: a gentle introduction

In this Chapter we show that by considering eye movements, and in partic...

Strategies for modelling open-loop saccade control of a cable-driven biomimetic robot eye

In human-robot interactions, eye movements play an important role in non...

Bayesian Dynamical Modeling of Fixational Eye Movements

Humans constantly move their eyes, even during visual fixations, where m...

Understanding Humans' Strategies in Maze Solving

Navigating through a visual maze relies on the strategic use of eye move...

Moment-to-Moment Detection of Internal Thought from Eye Vergence Behaviour

Internal thought refers to the process of directing attention away from ...