Modeling Dynamics of Facial Behavior for Mental Health Assessment

08/23/2021
by   Minh Tran, et al.
0

Facial action unit (FAU) intensities are popular descriptors for the analysis of facial behavior. However, FAUs are sparsely represented when only a few are activated at a time. In this study, we explore the possibility of representing the dynamics of facial expressions by adopting algorithms used for word representation in natural language processing. Specifically, we perform clustering on a large dataset of temporal facial expressions with 5.3M frames before applying the Global Vector representation (GloVe) algorithm to learn the embeddings of the facial clusters. We evaluate the usefulness of our learned representations on two downstream tasks: schizophrenia symptom estimation and depression severity regression. These experimental results show the potential effectiveness of our approach for improving the assessment of mental health symptoms over baseline models that use FAU intensities alone.

READ FULL TEXT
research
11/21/2018

Measuring Depression Symptom Severity from Spoken Language and 3D Facial Expressions

With more than 300 million people depressed worldwide, depression is a g...
research
08/07/2018

SchiNet: Automatic Estimation of Symptoms of Schizophrenia from Facial Behaviour Analysis

Patients with schizophrenia often display impairments in the expression ...
research
08/02/2022

The Face of Affective Disorders

We study the statistical properties of facial behaviour altered by the r...
research
03/16/2023

Facial Affective Behavior Analysis Method for 5th ABAW Competition

Facial affective behavior analysis is important for human-computer inter...
research
11/12/2022

MARLIN: Masked Autoencoder for facial video Representation LearnINg

This paper proposes a self-supervised approach to learn universal facial...
research
06/16/2015

Using Hankel Matrices for Dynamics-based Facial Emotion Recognition and Pain Detection

This paper proposes a new approach to model the temporal dynamics of a s...
research
11/22/2021

Inferring User Facial Affect in Work-like Settings

Unlike the six basic emotions of happiness, sadness, fear, anger, disgus...

Please sign up or login with your details

Forgot password? Click here to reset