Detection and Localization of Facial Expression Manipulations

03/15/2021
by   Ghazal Mazaheri, et al.
0

Concern regarding the wide-spread use of fraudulent images/videos in social media necessitates precise detection of such fraud. The importance of facial expressions in communication is widely known, and adversarial attacks often focus on manipulating the expression related features. Thus, it is important to develop methods that can detect manipulations in facial expressions, and localize the manipulated regions. To address this problem, we propose a framework that is able to detect manipulations in facial expression using a close combination of facial expression recognition and image manipulation methods. With the addition of feature maps extracted from the facial expression recognition framework, our manipulation detector is able to localize the manipulated region. We show that, on the Face2Face dataset, where there is abundant expression manipulation, our method achieves over 3 for both classification and localization of manipulations compared to state-of-the-art methods. In addition, results on the NeuralTextures dataset where the facial expressions corresponding to the mouth regions have been modified, show 2 manipulation. We demonstrate that the method performs at-par with the state-of-the-art methods in cases where the expression is not manipulated, but rather the identity is changed, thus ensuring generalizability of the approach.

READ FULL TEXT

page 1

page 2

page 6

page 10

research
10/23/2020

The Analysis of Facial Feature Deformation using Optical Flow Algorithm

Facial features deformed according to the intended facial expression. Sp...
research
08/19/2022

Intensity-Aware Loss for Dynamic Facial Expression Recognition in the Wild

Compared with the image-based static facial expression recognition (SFER...
research
09/30/2018

Spontaneous Facial Expression Recognition using Sparse Representation

Facial expression is the most natural means for human beings to communic...
research
03/24/2022

Privileged Attribution Constrained Deep Networks for Facial Expression Recognition

Facial Expression Recognition (FER) is crucial in many research domains ...
research
11/13/2018

Automated Pain Detection from Facial Expressions using FACS: A Review

Facial pain expression is an important modality for assessing pain, espe...
research
01/25/2018

Using Deep Autoencoders for Facial Expression Recognition

Feature descriptors involved in image processing are generally manually ...
research
01/11/2018

Soft Locality Preserving Map (SLPM) for Facial Expression Recognition

For image recognition, an extensive number of methods have been proposed...

Please sign up or login with your details

Forgot password? Click here to reset