FakeTracer: Proactively Defending Against Face-swap DeepFakes via Implanting Traces in Training

07/27/2023
by   Pu Sun, et al.
0

Face-swap DeepFake is an emerging AI-based face forgery technique that can replace the original face in a video with a generated face of the target identity while retaining consistent facial attributes such as expression and orientation. Due to the high privacy of faces, the misuse of this technique can raise severe social concerns, drawing tremendous attention to defend against DeepFakes recently. In this paper, we describe a new proactive defense method called FakeTracer to expose face-swap DeepFakes via implanting traces in training. Compared to general face-synthesis DeepFake, the face-swap DeepFake is more complex as it involves identity change, is subjected to the encoding-decoding process, and is trained unsupervised, increasing the difficulty of implanting traces into the training phase. To effectively defend against face-swap DeepFake, we design two types of traces, sustainable trace (STrace) and erasable trace (ETrace), to be added to training faces. During the training, these manipulated faces affect the learning of the face-swap DeepFake model, enabling it to generate faces that only contain sustainable traces. In light of these two traces, our method can effectively expose DeepFakes by identifying them. Extensive experiments are conducted on the Celeb-DF dataset, compared with recent passive and proactive defense methods, and are studied thoroughly regarding various factors, corroborating the efficacy of our method on defending against face-swap DeepFake.

READ FULL TEXT

page 1

page 2

page 6

page 7

page 8

page 10

page 12

research
07/08/2022

Deepfake Face Traceability with Disentangling Reversing Network

Deepfake face not only violates the privacy of personal identity, but al...
research
05/13/2019

Robustness Analysis of Face Obscuration

Face obscuration is often needed by law enforcement or mass media outlet...
research
02/12/2019

De-identification without losing faces

Training of deep learning models for computer vision requires large imag...
research
07/31/2022

Neural Correlates of Face Familiarity Perception

In the domain of face recognition, there exists a puzzling timing discre...
research
01/27/2023

FRA: A novel Face Representation Augmentation algorithm for face recognition

A low amount of training data for many state-of-the-art deep learning-ba...
research
03/09/2022

Region-Aware Face Swapping

This paper presents a novel Region-Aware Face Swapping (RAFSwap) network...
research
08/19/2023

Recap: Detecting Deepfake Video with Unpredictable Tampered Traces via Recovering Faces and Mapping Recovered Faces

The exploitation of Deepfake techniques for malicious intentions has dri...

Please sign up or login with your details

Forgot password? Click here to reset