Defending against GAN-based Deepfake Attacks via Transformation-aware Adversarial Faces

06/12/2020
by   Chaofei Yang, et al.
0

Deepfake represents a category of face-swapping attacks that leverage machine learning models such as autoencoders or generative adversarial networks. Although the concept of the face-swapping is not new, its recent technical advances make fake content (e.g., images, videos) more realistic and imperceptible to Humans. Various detection techniques for Deepfake attacks have been explored. These methods, however, are passive measures against Deepfakes as they are mitigation strategies after the high-quality fake content is generated. More importantly, we would like to think ahead of the attackers with robust defenses. This work aims to take an offensive measure to impede the generation of high-quality fake images or videos. Specifically, we propose to use novel transformation-aware adversarially perturbed faces as a defense against GAN-based Deepfake attacks. Different from the naive adversarial faces, our proposed approach leverages differentiable random image transformations during the generation. We also propose to use an ensemble-based approach to enhance the defense robustness against GAN-based Deepfake variants under the black-box setting. We show that training a Deepfake model with adversarial faces can lead to a significant degradation in the quality of synthesized faces. This degradation is twofold. On the one hand, the quality of the synthesized faces is reduced with more visual artifacts such that the synthesized faces are more obviously fake or less convincing to human observers. On the other hand, the synthesized faces can easily be detected based on various metrics.

READ FULL TEXT

page 6

page 8

page 13

page 14

research
06/21/2019

Hiding Faces in Plain Sight: Disrupting AI Face Synthesis with Adversarial Perturbations

Recent years have seen fast development in synthesizing realistic human ...
research
10/21/2021

PROVES: Establishing Image Provenance using Semantic Signatures

Modern AI tools, such as generative adversarial networks, have transform...
research
01/24/2021

Fighting deepfakes by detecting GAN DCT anomalies

Synthetic multimedia content created through AI technologies, such as Ge...
research
03/27/2020

One-Shot GAN Generated Fake Face Detection

Fake face detection is a significant challenge for intelligent systems a...
research
09/24/2020

Exposing GAN-generated Faces Using Inconsistent Corneal Specular Highlights

Sophisticated generative adversary network (GAN) models are now able to ...
research
09/13/2019

FakeSpotter: A Simple Baseline for Spotting AI-Synthesized Fake Faces

In recent years, we have witnessed the unprecedented success of generati...
research
02/07/2022

A new face swap method for image and video domains: a technical report

Deep fake technology became a hot field of research in the last few year...

Please sign up or login with your details

Forgot password? Click here to reset