Inferring Dynamic Representations of Facial Actions from a Still Image

04/04/2019
by   Siyang Song, et al.
0

Facial actions are spatio-temporal signals by nature, and therefore their modeling is crucially dependent on the availability of temporal information. In this paper, we focus on inferring such temporal dynamics of facial actions when no explicit temporal information is available, i.e. from still images. We present a novel approach to capture multiple scales of such temporal dynamics, with an application to facial Action Unit (AU) intensity estimation and dimensional affect estimation. In particular, 1) we propose a framework that infers a dynamic representation (DR) from a still image, which captures the bi-directional flow of time within a short time-window centered at the input image; 2) we show that we can train our method without the need of explicitly generating target representations, allowing the network to represent dynamics more broadly; and 3) we propose to apply a multiple temporal scale approach that infers DRs for different window lengths (MDR) from a still image. We empirically validate the value of our approach on the task of frame ranking, and show how our proposed MDR attains state of the art results on BP4D for AU intensity estimation and on SEMAINE for dimensional affect estimation, using only still images at test time.

READ FULL TEXT

page 3

page 7

research
11/17/2020

Spatio-Temporal Analysis of Facial Actions using Lifecycle-Aware Capsule Networks

Most state-of-the-art approaches for Facial Action Unit (AU) detection r...
research
03/01/2023

FaceRNET: a Facial Expression Intensity Estimation Network

This paper presents our approach for Facial Expression Intensity Estimat...
research
11/03/2020

Semi-supervised Facial Action Unit Intensity Estimation with Contrastive Learning

This paper tackles the challenging problem of estimating the intensity o...
research
05/01/2014

Relative Facial Action Unit Detection

This paper presents a subject-independent facial action unit (AU) detect...
research
06/20/2022

Extracting Fast and Slow: User-Action Embedding with Inter-temporal Information

With the recent development of technology, data on detailed human tempor...
research
05/09/2018

Joint Action Unit localisation and intensity estimation through heatmap regression

This paper proposes a supervised learning approach to jointly perform fa...
research
06/24/2020

Automatic Estimation of Self-Reported Pain by Interpretable Representations of Motion Dynamics

We propose an automatic method for pain intensity measurement from video...

Please sign up or login with your details

Forgot password? Click here to reset