Can We Assess Mental Health through Social Media and Smart Devices? Addressing Bias in Methodology and Evaluation

07/19/2018
by   Adam Tsakalidis, et al.
1

Predicting mental health from smartphone and social media data on a longitudinal basis has recently attracted great interest, with very promising results being reported across many studies. Such approaches have the potential to revolutionise mental health assessment, if their development and evaluation follows a real world deployment setting. In this work we take a closer look at state-of-the-art approaches, using different mental health datasets and indicators, different feature sources and multiple simulations, in order to assess their ability to generalise. We demonstrate that under a pragmatic evaluation framework, none of the approaches deliver or even approach the reported performances. In fact, we show that current state-of-the-art approaches can barely outperform the most naïve baselines in the real-world setting, posing serious questions not only about their deployment ability, but also about the contribution of the derived features for the mental health assessment task and how to make better use of such data in the future.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/20/2018

RSDD-Time: Temporal Annotation of Self-Reported Mental Health Diagnoses

Self-reported diagnosis statements have been widely employed in studying...
research
01/25/2023

Predicting mental health using social media: A roadmap for future development

Mental disorders such as depression and suicidal ideation are hazardous,...
research
08/30/2020

Temporal Mental Health Dynamics on Social Media

We describe a set of experiments for building a temporal mental health d...
research
06/22/2022

Then and Now: Quantifying the Longitudinal Validity of Self-Disclosed Depression Diagnoses

Self-disclosed mental health diagnoses, which serve as ground truth anno...
research
06/05/2021

Weakly-Supervised Methods for Suicide Risk Assessment: Role of Related Domains

Social media has become a valuable resource for the study of suicidal id...
research
04/21/2022

Improving the Generalizability of Depression Detection by Leveraging Clinical Questionnaires

Automated methods have been widely used to identify and analyze mental h...
research
06/27/2023

Bayesian Interrupted Time Series for evaluating policy change on mental well-being: an application to England's welfare reform

Factors contributing to social inequalities are also associated with neg...

Please sign up or login with your details

Forgot password? Click here to reset