DeepTag: Robust Image Tagging for DeepFake Provenance

09/21/2020
by   Run Wang, et al.
0

In recent years, DeepFake is becoming a common threat to our society, due to the remarkable progress of generative adversarial networks (GAN) in image synthesis. Unfortunately, existing studies that propose various approaches, in fighting against DeepFake, to determine if the facial image is real or fake, is still at an early stage. Obviously, the current DeepFake detection method struggles to catchthe rapid progress of GANs, especially in the adversarial scenarios where attackers can evade the detection intentionally, such as adding perturbations to fool DNN-based detectors. While passive detection simply tells whether the image is fake or real, DeepFake provenance, on the other hand, provides clues for tracking the sources in DeepFake forensics. Thus, the tracked fake images could be blocked immediately by administrators and avoid further spread in social networks. In this paper, we investigated the potentials of image tagging in serving the DeepFake provenance. Specifically, we devise a deep learning-based approach, named DeepTag, with a simple yet effective encoder and decoder design to embed message to the facial image, which is to recover the embedded message after various drastic GAN-based DeepFake transformation with high confidence. The embedded message could be employed to represent the identity of facial images, which further contributed to DeepFake detection and provenance. Experimental results demonstrate that our proposed approach could recover the embedded message with an average accuracy of nearly 90 effective privacy-preserving techniques for protecting personal photos from being DeepFaked. Thus, effective proactive defense mechanisms should be developed for fighting against DeepFakes, instead of simply devising DeepFake detection methods that can be mostly ineffective in practice.

READ FULL TEXT

page 1

page 4

research
03/21/2023

Information-containing Adversarial Perturbation for Combating Facial Manipulation Systems

With the development of deep learning technology, the facial manipulatio...
research
11/13/2019

Real or Fake? Spoofing State-Of-The-Art Face Synthesis Detection Systems

The availability of large-scale facial databases, together with the rema...
research
04/25/2023

Docmarking: Real-Time Screen-Cam Robust Document Image Watermarking

This paper focuses on investigation of confidential documents leaks in t...
research
10/29/2020

Perception Matters: Exploring Imperceptible and Transferable Anti-forensics for GAN-generated Fake Face Imagery Detection

Recently, generative adversarial networks (GANs) can generate photo-real...
research
12/15/2021

Exploring the Asynchronous of the Frequency Spectra of GAN-generated Facial Images

The rapid progression of Generative Adversarial Networks (GANs) has rais...
research
01/09/2018

Fake Colorized Image Detection

Image forensics aims to detect the manipulation of digital images. Curre...
research
04/05/2022

FaceSigns: Semi-Fragile Neural Watermarks for Media Authentication and Countering Deepfakes

Deepfakes and manipulated media are becoming a prominent threat due to t...

Please sign up or login with your details

Forgot password? Click here to reset