Accurate and Robust Eye Contact Detection During Everyday Mobile Device Interactions

07/25/2019
by   Mihai Bâce, et al.
3

Quantification of human attention is key to several tasks in mobile human-computer interaction (HCI), such as predicting user interruptibility, estimating noticeability of user interface content, or measuring user engagement. Previous works to study mobile attentive behaviour required special-purpose eye tracking equipment or constrained users' mobility. We propose a novel method to sense and analyse visual attention on mobile devices during everyday interactions. We demonstrate the capabilities of our method on the sample task of eye contact detection that has recently attracted increasing research interest in mobile HCI. Our method builds on a state-of-the-art method for unsupervised eye contact detection and extends it to address challenges specific to mobile interactive scenarios. Through evaluation on two current datasets, we demonstrate significant performance improvements for eye contact detection across mobile devices, users, or environmental conditions. Moreover, we discuss how our method enables the calculation of additional attention metrics that, for the first time, enable researchers from different domains to study and quantify attention allocation during mobile interactions in the wild.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

page 8

page 9

research
07/25/2019

How far are we from quantifying visual attention in mobile HCI?

With an ever-increasing number of mobile devices competing for our atten...
research
01/18/2018

Forecasting User Attention During Everyday Mobile Interactions Using Device-Integrated and Wearable Sensors

Users' visual attention is highly fragmented during mobile interactions ...
research
08/07/2023

Eye-Shield: Real-Time Protection of Mobile Device Screen Information from Shoulder Surfing

People use mobile devices ubiquitously for computing, communication, sto...
research
07/09/2021

MutualEyeContact: A conversation analysis tool with focus on eye contact

Eye contact between individuals is particularly important for understand...
research
12/08/2021

Do Pedestrians Pay Attention? Eye Contact Detection in the Wild

In urban or crowded environments, humans rely on eye contact for fast an...
research
02/12/2023

LipLearner: Customizable Silent Speech Interactions on Mobile Devices

Silent speech interface is a promising technology that enables private c...
research
03/29/2021

Onfocus Detection: Identifying Individual-Camera Eye Contact from Unconstrained Images

Onfocus detection aims at identifying whether the focus of the individua...

Please sign up or login with your details

Forgot password? Click here to reset