Dynamics of eye-hand coordination are flexibly preserved in eye-cursor coordination during an online, digital, object interaction task

04/12/2023
by   Jennifer K Bertrand, et al.
0

Do patterns of eye-hand coordination observed during real-world object interactions apply to digital, screen-based object interactions? We adapted a real-world object interaction task (physically transferring cups in sequence about a tabletop) into a two-dimensional screen-based task (dragging-and-dropping circles in sequence with a cursor). We collected gaze (with webcam eye-tracking) and cursor position data from 51 fully-remote, crowd-sourced participants who performed the task on their own computer. We applied real-world time-series data segmentation strategies to resolve the self-paced movement sequence into phases of object interaction and rigorously cleaned the webcam eye-tracking data. In this preliminary investigation, we found that: 1) real-world eye-hand coordination patterns persist and adapt in this digital context, and 2) remote, online, cursor-tracking and webcam eye-tracking are useful tools for capturing visuomotor behaviours during this ecologically-valid human-computer interaction task. We discuss how these findings might inform design principles and further investigations into natural behaviours that persist in digital environments.

READ FULL TEXT

page 4

page 5

page 8

research
12/22/2013

A Survey on Eye-Gaze Tracking Techniques

Study of eye-movement is being employed in Human Computer Interaction (H...
research
08/30/2023

(Mis)align: A Simple Dynamic Framework for Modeling Interpersonal Coordination

As people coordinate in daily interactions, they engage in different pat...
research
04/26/2023

GazeSAM: What You See is What You Segment

This study investigates the potential of eye-tracking technology and the...
research
03/30/2018

Seeing virtual while acting real: Visual display and strategy effects on the time and precision of eye-hand coordination

Effects of computer generated 2D and 3D views on the time and precision ...
research
11/02/2018

Exploring Gaze Behavior to Assess Performance in Digital Game-Based Learning Systems

The recent growth of sophisticated digital gaming technologies has spawn...
research
10/02/2019

Indicators of retention in remote digital health studies: A cross-study evaluation of 100,000 participants

Digital technologies such as smartphones are transforming the way scient...
research
02/12/2021

Rethinking Eye-blink: Assessing Task Difficulty through Physiological Representation of Spontaneous Blinking

Continuous assessment of task difficulty and mental workload is essentia...

Please sign up or login with your details

Forgot password? Click here to reset