Image Features Influence Reaction Time: A Learned Probabilistic Perceptual Model for Saccade Latency

05/05/2022
by   Budmonde Duinkharjav, et al.
0

We aim to ask and answer an essential question "how quickly do we react after observing a displayed visual target?" To this end, we present psychophysical studies that characterize the remarkable disconnect between human saccadic behaviors and spatial visual acuity. Building on the results of our studies, we develop a perceptual model to predict temporal gaze behavior, particularly saccadic latency, as a function of the statistics of a displayed image. Specifically, we implement a neurologically-inspired probabilistic model that mimics the accumulation of confidence that leads to a perceptual decision. We validate our model with a series of objective measurements and user studies using an eye-tracked VR display. The results demonstrate that our model prediction is in statistical alignment with real-world human behavior. Further, we establish that many sub-threshold image modifications commonly introduced in graphics pipelines may significantly alter human reaction timing, even if the differences are visually undetectable. Finally, we show that our model can serve as a metric to predict and alter reaction latency of users in interactive computer graphics applications, thus may improve gaze-contingent rendering, design of virtual experiences, and player performance in e-sports. We illustrate this with two examples: estimating competition fairness in a video game with two different team colors, and tuning display viewing distance to minimize player reaction time.

READ FULL TEXT

page 1

page 5

page 10

page 14

page 19

page 20

page 21

research
06/24/2019

Gaze-Contingent Ocular Parallax Rendering for Virtual Reality

Immersive computer graphics systems strive to generate perceptually real...
research
06/19/2017

Visual Decoding of Targets During Visual Search From Human Eye Fixations

What does human gaze reveal about a users' intents and to which extend c...
research
09/15/2022

Color-Perception-Guided Display Power Reduction for Virtual Reality

Battery life is an increasingly urgent challenge for today's untethered ...
research
06/20/2023

Computing a human-like reaction time metric from stable recurrent vision models

The meteoric rise in the adoption of deep neural networks as computation...
research
08/10/2021

Gaze-Contingent Retinal Speckle Suppression for Perceptually-Matched Foveated Holographic Displays

Computer-generated holographic (CGH) displays show great potential and a...
research
04/28/2021

A Perceptual Model for Eccentricity-dependent Spatio-temporal Flicker Fusion and its Applications to Foveated Graphics

Virtual and augmented reality (VR/AR) displays strive to provide a resol...
research
10/05/2021

Metameric Varifocal Holography

Computer-Generated Holography (CGH) offers the potential for genuine, hi...

Please sign up or login with your details

Forgot password? Click here to reset