Can gamification reduce the burden of self-reporting in mHealth applications? Feasibility study using machine learning from smartwatch data to estimate cognitive load

02/07/2023
by   Michał K. Grzeszczyk, et al.
0

The effectiveness of digital treatments can be measured by requiring patients to self-report their mental and physical state through mobile applications. However, self-reporting can be overwhelming and may cause patients to disengage from the intervention. In order to address this issue, we conduct a feasibility study to explore the impact of gamification on the cognitive burden of self-reporting. Our approach involves the creation of a system to assess cognitive burden through the analysis of photoplethysmography (PPG) signals obtained from a smartwatch. The system is built by collecting PPG data during both cognitively demanding tasks and periods of rest. The obtained data is utilized to train a machine learning model to detect cognitive load (CL). Subsequently, we create two versions of health surveys: a gamified version and a traditional version. Our aim is to estimate the cognitive load experienced by participants while completing these surveys using their mobile devices. We find that CL detector performance can be enhanced via pre-training on stress detection tasks and requires capturing of a minimum 30 seconds of PPG signal to work adequately. For 10 out of 13 participants, a personalized cognitive load detector can achieve an F1 score above 0.7. We find no difference between the gamified and non-gamified mobile surveys in terms of time spent in the state of high cognitive load but participants prefer the gamified version. The average time spent on each question is 5.5 for gamified survey vs 6 seconds for the non-gamified version.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/30/2020

The Effectiveness of Haptic PropertiesUnder Cognitive Load: An Exploratory Study

With the rise of wearables, haptic interfaces are increasingly favored t...
research
05/30/2020

The Effectiveness of Haptic Properties Under Cognitive Load: An Exploratory Study

With the rise of wearables, haptic interfaces are increasingly favored t...
research
11/02/2021

Cognitive Load and Productivity Implications in Human-Chatbot Interaction

The increasing progress in artificial intelligence and respective machin...
research
09/16/2019

Automatic Detection and Classification of Cognitive Distortions in Mental Health Text

In cognitive psychology, automatic and self-reinforcing irrational thoug...
research
04/20/2023

Using Mobile Data and Deep Models to Assess Auditory Verbal Hallucinations

Hallucination is an apparent perception in the absence of real external ...
research
05/13/2022

AVCAffe: A Large Scale Audio-Visual Dataset of Cognitive Load and Affect for Remote Work

We introduce AVCAffe, the first Audio-Visual dataset consisting of Cogni...
research
04/19/2023

Personalized State Anxiety Detection: An Empirical Study with Linguistic Biomarkers and A Machine Learning Pipeline

Individuals high in social anxiety symptoms often exhibit elevated state...

Please sign up or login with your details

Forgot password? Click here to reset