DeepAI AI Chat
Log In Sign Up

Modeling Human Eye Movements with Neural Networks in a Maze-Solving Task

12/20/2022
by   Jason Li, et al.
Boston University
MIT
0

From smoothly pursuing moving objects to rapidly shifting gazes during visual search, humans employ a wide variety of eye movement strategies in different contexts. While eye movements provide a rich window into mental processes, building generative models of eye movements is notoriously difficult, and to date the computational objectives guiding eye movements remain largely a mystery. In this work, we tackled these problems in the context of a canonical spatial planning task, maze-solving. We collected eye movement data from human subjects and built deep generative models of eye movements using a novel differentiable architecture for gaze fixations and gaze shifts. We found that human eye movements are best predicted by a model that is optimized not to perform the task as efficiently as possible but instead to run an internal simulation of an object traversing the maze. This not only provides a generative model of eye movements in this task but also suggests a computational theory for how humans solve the task, namely that humans use mental simulation.

READ FULL TEXT

page 2

page 6

03/25/2020

Discriminative Viewer Identification using Generative Models of Eye Gaze

We study the problem of identifying viewers of arbitrary images based on...
07/29/2019

Task Classification Model for Visual Fixation, Exploration, and Search

Yarbus' claim to decode the observer's task from eye movements has recei...
06/23/2015

Advanced statistical methods for eye movement analysis and modeling: a gentle introduction

In this Chapter we show that by considering eye movements, and in partic...
03/01/2022

Strategies for modelling open-loop saccade control of a cable-driven biomimetic robot eye

In human-robot interactions, eye movements play an important role in non...
03/21/2023

Bayesian Dynamical Modeling of Fixational Eye Movements

Humans constantly move their eyes, even during visual fixations, where m...
07/22/2013

Understanding Humans' Strategies in Maze Solving

Navigating through a visual maze relies on the strategic use of eye move...
01/19/2019

Moment-to-Moment Detection of Internal Thought from Eye Vergence Behaviour

Internal thought refers to the process of directing attention away from ...