Multi-label Learning with Missing Values using Combined Facial Action Unit Datasets

08/17/2020
by   Jaspar Pahl, et al.
6

Facial action units allow an objective, standardized description of facial micro movements which can be used to describe emotions in human faces. Annotating data for action units is an expensive and time-consuming task, which leads to a scarce data situation. By combining multiple datasets from different studies, the amount of training data for a machine learning algorithm can be increased in order to create robust models for automated, multi-label action unit detection. However, every study annotates different action units, leading to a tremendous amount of missing labels in a combined database. In this work, we examine this challenge and present our approach to create a combined database and an algorithm capable of learning under the presence of missing labels without inferring their values. Our approach shows competitive performance compared to recent competitions in action unit detection.

READ FULL TEXT
research
02/08/2020

Multi-Label Class Balancing Algorithm for Action Unit Detection

Isolated facial movements, so-called Action Units, can describe combined...
research
02/04/2020

To-sequence:Multi-label Relation Modeling in Facial Action Units Detection

Facial Action Units Detection (FAUD), one of the main approaches for fac...
research
03/23/2022

Multi-label Transformer for Action Unit Detection

Action Unit (AU) Detection is the branch of affective computing that aim...
research
02/17/2021

Automated Detection of Equine Facial Action Units

The recently developed Equine Facial Action Coding System (EquiFACS) pro...
research
03/29/2017

Learning with Privileged Information for Multi-Label Classification

In this paper, we propose a novel approach for learning multi-label clas...
research
08/02/2016

Modeling Spatial and Temporal Cues for Multi-label Facial Action Unit Detection

Facial action units (AUs) are essential to decode human facial expressio...
research
01/06/2022

Predicting Trust Using Automated Assessment of Multivariate Interactional Synchrony

Diverse disciplines are interested in how the coordination of interactin...

Please sign up or login with your details

Forgot password? Click here to reset