Domain-specific Learning of Multi-scale Facial Dynamics for Apparent Personality Traits Prediction

09/09/2022
by   Fang Li, et al.
0

Human personality decides various aspects of their daily life and working behaviors. Since personality traits are relatively stable over time and unique for each subject, previous approaches frequently infer personality from a single frame or short-term behaviors. Moreover, most of them failed to specifically extract person-specific and unique cues for personality recognition. In this paper, we propose a novel video-based automatic personality traits recognition approach which consists of: (1) a domain-specific facial behavior modelling module that extracts personality-related multi-scale short-term human facial behavior features; (2) a long-term behavior modelling module that summarizes all short-term features of a video as a long-term/video-level personality representation and (3) a multi-task personality traits prediction module that models underlying relationship among all traits and jointly predict them based on the video-level personality representation. We conducted the experiments on ChaLearn First Impression dataset, and our approach achieved comparable results to the state-of-the-art. Importantly, we show that all three proposed modules brought important benefits for personality recognition.

READ FULL TEXT

page 7

page 9

research
03/01/2023

Learning Person-specific Network Representation for Apparent Personality Traits Recognition

Recent studies show that apparent personality traits can be reflected fr...
research
11/30/2021

Two-stage Temporal Modelling Framework for Video-based Depression Recognition using Graph Representation

Video-based automatic depression analysis provides a fast, objective and...
research
11/20/2022

Non-verbal Facial Action Units-based Automatic Depression Classification

Depression is a common mental disorder that causes people to experience ...
research
05/24/2021

Taylor saves for later: disentanglement for video prediction using Taylor representation

Video prediction is a challenging task with wide application prospects i...
research
10/26/2021

Learning Graph Representation of Person-specific Cognitive Processes from Audio-visual Behaviours for Automatic Personality Recognition

This approach builds on two following findings in cognitive science: (i)...
research
02/20/2023

Explainable Human-centered Traits from Head Motion and Facial Expression Dynamics

We explore the efficacy of multimodal behavioral cues for explainable pr...
research
12/15/2021

Head Matters: Explainable Human-centered Trait Prediction from Head Motion Dynamics

We demonstrate the utility of elementary head-motion units termed kineme...

Please sign up or login with your details

Forgot password? Click here to reset