Choose Settings Carefully: Comparing Action Unit detection at Different Settings Using a Large-Scale Dataset

11/16/2021
by   Mina Bishay, et al.
0

In this paper, we investigate the impact of some of the commonly used settings for (a) preprocessing face images, and (b) classification and training, on Action Unit (AU) detection performance and complexity. We use in our investigation a large-scale dataset, consisting of  55K videos collected in the wild for participants watching commercial ads. The preprocessing settings include scaling the face to a fixed resolution, changing the color information (RGB to gray-scale), aligning the face, and cropping AU regions, while the classification and training settings include the kind of classifier (multi-label vs. binary) and the amount of data used for training models. To the best of our knowledge, no work had investigated the effect of those settings on AU detection. In our analysis we use CNNs as our baseline classification model.

READ FULL TEXT
research
11/16/2021

Which CNNs and Training Settings to Choose for Action Unit Detection? A Study Based on a Large-Scale Dataset

In this paper we explore the influence of some frequently used Convoluti...
research
10/15/2020

Impact of Action Unit Occurrence Patterns on Detection

Detecting action units is an important task in face analysis, especially...
research
02/08/2020

Multi-Label Class Balancing Algorithm for Action Unit Detection

Isolated facial movements, so-called Action Units, can describe combined...
research
03/23/2022

Multi-label Transformer for Action Unit Detection

Action Unit (AU) Detection is the branch of affective computing that aim...
research
12/06/2019

DeepEthnic: Multi-Label Ethnic Classification from Face Images

Ethnic group classification is a well-researched problem, which has been...
research
02/04/2020

Multi-label Relation Modeling in Facial Action Units Detection

This paper describes an approach to the facial action units detections. ...
research
07/30/2020

Hierarchical Action Classification with Network Pruning

Research on human action classification has made significant progresses ...

Please sign up or login with your details

Forgot password? Click here to reset