From Pixels to Affect: A Study on Games and Player Experience

07/04/2019
by   Konstantinos Makantasis, et al.
0

Is it possible to predict the affect of a user just by observing her behavioral interaction through a video? How can we, for instance, predict a user's arousal in games by merely looking at the screen during play? In this paper we address these questions by employing three dissimilar deep convolutional neural network architectures in our attempt to learn the underlying mapping between video streams of gameplay and the player's arousal. We test the algorithms in an annotated dataset of 50 gameplay videos of a survival shooter game and evaluate the deep learned models' capacity to classify high vs low arousal levels. Our key findings with the demanding leave-one-video-out validation method reveal accuracies of over 78 and 98 test domain, the findings and methodology are directly relevant to any affective computing area, introducing a general and user-agnostic approach for modeling affect.

READ FULL TEXT

page 4

page 6

research
01/26/2021

The Pixels and Sounds of Emotion: General-Purpose Representations of Arousal in Games

What if emotion could be captured in a general and subject-agnostic fash...
research
10/03/2021

Towards General Models of Player Experience: A Study Within Genres

To which degree can abstract gameplay metrics capture the player experie...
research
06/16/2020

Play with One's Feelings: A Study on Emotion Awareness for Player Experience

Affective interaction between players of video games can elicit rich and...
research
12/07/2022

Improving Deep Localized Level Analysis: How Game Logs Can Help

Player modelling is the field of study associated with understanding pla...
research
08/17/2020

Moment-to-moment Engagement Prediction through the Eyes of the Observer: PUBG Streaming on Twitch

Is it possible to predict moment-to-moment gameplay engagement based sol...
research
01/31/2019

Your Gameplay Says it All: Modelling Motivation in Tom Clancy's The Division

Is it possible to predict the motivation of players just by observing th...
research
07/22/2021

Privileged Information for Modeling Affect In The Wild

A key challenge of affective computing research is discovering ways to r...

Please sign up or login with your details

Forgot password? Click here to reset