Predicting Human Performance in Vertical Menu Selection Using Deep Learning

03/13/2018
by   Yang Li, et al.
0

Predicting human performance in interaction tasks allows designers or developers to understand the expected performance of a target interface without actually testing it with real users. In this work, we present a deep neural net to model and predict human performance in performing a sequence of UI tasks. In particular, we focus on a dominant class of tasks, i.e., target selection from a vertical list or menu. We experimented with our deep neural net using a public dataset collected from a desktop laboratory environment and a dataset collected from hundreds of touchscreen smartphone users via crowdsourcing. Our model significantly outperformed previous methods on these datasets. Importantly, our method, as a deep model, can easily incorporate additional UI attributes such as visual appearance and content semantics without changing model architectures. By understanding about how a deep learning model learns from human behaviors, our approach can be seen as a vehicle to discover new patterns about human behaviors to advance analytical modeling.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/12/2013

Horizontal and Vertical Ensemble with Deep Representation for Classification

Representation learning, especially which by using deep learning, has be...
research
11/25/2018

Visual Attention on the Sun: What Do Existing Models Actually Predict?

Visual attention prediction is a classic problem that seems to be well a...
research
05/23/2016

Genetic Architect: Discovering Genomic Structure with Learned Neural Architectures

Each human genome is a 3 billion base pair set of encoding instructions....
research
06/08/2020

Deep Neural Network Based Real-time Kiwi Fruit Flower Detection in an Orchard Environment

In this paper, we present a novel approach to kiwi fruit flower detectio...
research
02/28/2019

Modeling Mobile Interface Tappability Using Crowdsourcing and Deep Learning

Tapping is an immensely important gesture in mobile touchscreen interfac...
research
08/12/2020

Polyth-Net: Classification of Polythene Bags for Garbage Segregation Using Deep Learning

Polythene has always been a threat to the environment since its inventio...
research
03/30/2019

Prediction Model for Semitransparent Watercolor Pigment Mixtures Using Deep Learning with a Dataset of Transmittance and Reflectance

Learning color mixing is difficult for novice painters. In order to supp...

Please sign up or login with your details

Forgot password? Click here to reset