MorphGAN: One-Shot Face Synthesis GAN for Detecting Recognition Bias

12/09/2020
by   Nataniel Ruiz, et al.
0

To detect bias in face recognition networks, it can be useful to probe a network under test using samples in which only specific attributes vary in some controlled way. However, capturing a sufficiently large dataset with specific control over the attributes of interest is difficult. In this work, we describe a simulator that applies specific head pose and facial expression adjustments to images of previously unseen people. The simulator first fits a 3D morphable model to a provided image, applies the desired head pose and facial expression controls, then renders the model into an image. Next, a conditional Generative Adversarial Network (GAN) conditioned on the original image and the rendered morphable model is used to produce the image of the original person with the new facial expression and head pose. We call this conditional GAN – MorphGAN. Images generated using MorphGAN conserve the identity of the person in the original image, and the provided control over head pose and facial expression allows test sets to be created to identify robustness issues of a facial recognition deep network with respect to pose and expression. Images generated by MorphGAN can also serve as data augmentation when training data are scarce. We show that by augmenting small datasets of faces with new poses and expressions improves the recognition performance by up to 9 augmentation and data scarcity.

READ FULL TEXT

page 5

page 8

page 9

page 10

page 11

page 12

page 13

page 14

research
10/12/2019

Facial Expression Recognition Using Human to Animated-Character Expression Translation

Facial expression recognition is a challenging task due to two major pro...
research
08/17/2022

Disentangling Identity and Pose for Facial Expression Recognition

Facial expression recognition (FER) is a challenging problem because the...
research
02/21/2018

Conditional Adversarial Synthesis of 3D Facial Action Units

Employing deep learning-based approaches for fine-grained facial express...
research
05/17/2023

LPMM: Intuitive Pose Control for Neural Talking-Head Model via Landmark-Parameter Morphable Model

While current talking head models are capable of generating photorealist...
research
03/21/2018

Generative Adversarial Talking Head: Bringing Portraits to Life with a Weakly Supervised Neural Network

This paper presents Generative Adversarial Talking Head (GATH), a novel ...
research
09/20/2012

Head Frontal-View Identification Using Extended LLE

Automatic head frontal-view identification is challenging due to appeara...
research
12/17/2021

Online Classroom Evaluation System Based on Multi-Reaction Estimation

Compared with traditional face-to-face teaching, online learning is more...

Please sign up or login with your details

Forgot password? Click here to reset