Landmark Enforcement and Style Manipulation for Generative Morphing

10/18/2022
by   Samuel Price, et al.
0

Morph images threaten Facial Recognition Systems (FRS) by presenting as multiple individuals, allowing an adversary to swap identities with another subject. Morph generation using generative adversarial networks (GANs) results in high-quality morphs unaffected by the spatial artifacts caused by landmark-based methods, but there is an apparent loss in identity with standard GAN-based morphing methods. In this paper, we propose a novel StyleGAN morph generation technique by introducing a landmark enforcement method to resolve this issue. Considering this method, we aim to enforce the landmarks of the morph image to represent the spatial average of the landmarks of the bona fide faces and subsequently the morph images to inherit the geometric identity of both bona fide faces. Exploration of the latent space of our model is conducted using Principal Component Analysis (PCA) to accentuate the effect of both the bona fide faces on the morphed latent representation and address the identity loss issue with latent domain averaging. Additionally, to improve high frequency reconstruction in the morphs, we study the train-ability of the noise input for the StyleGAN2 model.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

page 8

research
10/10/2021

Fine-grained Identity Preserving Landmark Synthesis for Face Reenactment

Recent face reenactment works are limited by the coarse reference landma...
research
03/30/2019

Exposing GAN-synthesized Faces Using Landmark Locations

Generative adversary networks (GANs) have recently led to highly realist...
research
06/20/2020

BRULÉ: Barycenter-Regularized Unsupervised Landmark Extraction

Unsupervised retrieval of image features is vital for many computer visi...
research
08/09/2023

Vector quantization loss analysis in VQGANs: a single-GPU ablation study for image-to-image synthesis

This study performs an ablation analysis of Vector Quantized Generative ...
research
04/26/2020

One-Shot Identity-Preserving Portrait Reenactment

We present a deep learning-based framework for portrait reenactment from...
research
12/28/2022

StyleID: Identity Disentanglement for Anonymizing Faces

Privacy of machine learning models is one of the remaining challenges th...
research
05/01/2019

3DFaceGAN: Adversarial Nets for 3D Face Representation, Generation, and Translation

Over the past few years, Generative Adversarial Networks (GANs) have gar...

Please sign up or login with your details

Forgot password? Click here to reset