Impact of Action Unit Occurrence Patterns on Detection

10/15/2020
by   Saurabh Hinduja, et al.
6

Detecting action units is an important task in face analysis, especially in facial expression recognition. This is due, in part, to the idea that expressions can be decomposed into multiple action units. In this paper we investigate the impact of action unit occurrence patterns on detection of action units. To facilitate this investigation, we review state of the art literature, for AU detection, on 2 state-of-the-art face databases that are commonly used for this task, namely DISFA, and BP4D. Our findings, from this literature review, suggest that action unit occurrence patterns strongly impact evaluation metrics (e.g. F1-binary). Along with the literature review, we also conduct multi and single action unit detection, as well as propose a new approach to explicitly train deep neural networks using the occurrence patterns to boost the accuracy of action unit detection. These experiments validate that action unit patterns directly impact the evaluation metrics.

READ FULL TEXT
research
03/24/2022

Multi-modal Multi-label Facial Action Unit Detection with Transformer

Facial Action Coding System is an important approach of facial expressio...
research
06/13/2018

Expression Empowered ResiDen Network for Facial Action Unit Detection

The paper explores the topic of Facial Action Unit (FAU) detection in th...
research
02/17/2021

Automated Detection of Equine Facial Action Units

The recently developed Equine Facial Action Coding System (EquiFACS) pro...
research
11/16/2021

Choose Settings Carefully: Comparing Action Unit detection at Different Settings Using a Large-Scale Dataset

In this paper, we investigate the impact of some of the commonly used se...
research
03/12/2022

EventFormer: AU Event Transformer for Facial Action Unit Event Detection

Facial action units (AUs) play an indispensable role in human emotion an...
research
08/20/2020

Facial movement synergies and Action Unit detection from distal wearable Electromyography and Computer Vision

Distal facial Electromyography (EMG) can be used to detect smiles and fr...
research
06/16/2015

Time Series Classification using the Hidden-Unit Logistic Model

We present a new model for time series classification, called the hidden...

Please sign up or login with your details

Forgot password? Click here to reset