Measuring Depression Symptom Severity from Spoken Language and 3D Facial Expressions

11/21/2018
by   Albert Haque, et al.
8

With more than 300 million people depressed worldwide, depression is a global problem. Due to access barriers such as social stigma, cost, and treatment availability, 60 services. Effective and efficient diagnosis relies on detecting clinical symptoms of depression. Automatic detection of depressive symptoms would potentially improve diagnostic accuracy and availability, leading to faster intervention. In this work, we present a machine learning method for measuring the severity of depressive symptoms. Our multi-modal method uses 3D facial expressions and spoken language, commonly available from modern cell phones. It demonstrates an average error of 3.67 points (15.3 clinically-validated Patient Health Questionnaire (PHQ) scale. For detecting major depressive disorder, our model demonstrates 83.3 specificity. Overall, this paper shows how speech recognition, computer vision, and natural language processing can be combined to assist mental health patients and practitioners. This technology could be deployed to cell phones worldwide and facilitate low-cost universal access to mental health care.

READ FULL TEXT
research
08/23/2021

Modeling Dynamics of Facial Behavior for Mental Health Assessment

Facial action unit (FAU) intensities are popular descriptors for the ana...
research
10/06/2018

Artificial Intelligence for Diabetes Case Management: The Intersection of Physical and Mental Health

Diabetes is a major public health problem in the United States, affectin...
research
09/26/2020

Mental Health and Sensing

Mental health is a global epidemic, affecting close to half a billion pe...
research
11/29/2017

Predicting Depression Severity by Multi-Modal Feature Engineering and Fusion

We present our preliminary work to determine if patient's vocal acoustic...
research
11/25/2018

A Method for Analysis of Patient Speech in Dialogue for Dementia Detection

We present an approach to automatic detection of Alzheimer's type dement...
research
08/02/2022

The Face of Affective Disorders

We study the statistical properties of facial behaviour altered by the r...
research
06/02/2022

Detecting the Severity of Major Depressive Disorder from Speech: A Novel HARD-Training Methodology

Major Depressive Disorder (MDD) is a common worldwide mental health issu...

Please sign up or login with your details

Forgot password? Click here to reset