Real-time Facial Expression Recognition "In The Wild” by Disentangling 3D Expression from Identity

05/12/2020
by   Mohammad Rami Koujan, et al.
7

Human emotions analysis has been the focus of many studies, especially in the field of Affective Computing, and is important for many applications, e.g. human-computer intelligent interaction, stress analysis, interactive games, animations, etc. Solutions for automatic emotion analysis have also benefited from the development of deep learning approaches and the availability of vast amount of visual facial data on the internet. This paper proposes a novel method for human emotion recognition from a single RGB image. We construct a large-scale dataset of facial videos (FaceVid), rich in facial dynamics, identities, expressions, appearance and 3D pose variations. We use this dataset to train a deep Convolutional Neural Network for estimating expression parameters of a 3D Morphable Model and combine it with an effective back-end emotion classifier. Our proposed framework runs at 50 frames per second and is capable of robustly estimating parameters of 3D expression variation and accurately recognizing facial expressions from in-the-wild images. We present extensive experimental evaluation that shows that the proposed method outperforms the compared techniques in estimating the 3D expression parameters and achieves state-of-the-art performance in recognising the basic emotions from facial images, as well as recognising stress from facial videos. from facial images.

READ FULL TEXT

page 1

page 2

page 7

research
03/12/2021

Facial emotion expressions in human-robot interaction: A survey

Facial expressions are an ideal means of communicating one's emotions or...
research
11/23/2013

Dynamic Model of Facial Expression Recognition based on Eigen-face Approach

Emotions are best way of communicating information; and sometimes it car...
research
05/11/2023

Emotion Recognition for Challenged People Facial Appearance in Social using Neural Network

Human communication is the vocal and non verbal signal to communicate wi...
research
01/10/2021

CapsField: Light Field-based Face and Expression Recognition in the Wild using Capsule Routing

Light field (LF) cameras provide rich spatio-angular visual representati...
research
12/27/2015

Improving Facial Analysis and Performance Driven Animation through Disentangling Identity and Expression

We present techniques for improving performance driven facial animation,...
research
06/19/2022

Hybrid Facial Expression Recognition (FER2013) Model for Real-Time Emotion Classification and Prediction

Facial Expression Recognition is a vital research topic in most fields r...
research
11/15/2021

Deep Semantic Manipulation of Facial Videos

Editing and manipulating facial features in videos is an interesting and...

Please sign up or login with your details

Forgot password? Click here to reset