Identity-Driven DeepFake Detection

by   Xiaoyi Dong, et al.

DeepFake detection has so far been dominated by “artifact-driven” methods and the detection performance significantly degrades when either the type of image artifacts is unknown or the artifacts are simply too hard to find. In this work, we present an alternative approach: Identity-Driven DeepFake Detection. Our approach takes as input the suspect image/video as well as the target identity information (a reference image or video). We output a decision on whether the identity in the suspect image/video is the same as the target identity. Our motivation is to prevent the most common and harmful DeepFakes that spread false information of a targeted person. The identity-based approach is fundamentally different in that it does not attempt to detect image artifacts. Instead, it focuses on whether the identity in the suspect image/video is true. To facilitate research on identity-based detection, we present a new large scale dataset “Vox-DeepFake", in which each suspect content is associated with multiple reference images collected from videos of a target identity. We also present a simple identity-based detection algorithm called the OuterFace, which may serve as a baseline for further research. Even trained without fake videos, the OuterFace algorithm achieves superior detection accuracy and generalizes well to different DeepFake methods, and is robust with respect to video degradation techniques – a performance not achievable with existing detection algorithms.


page 1

page 3

page 4

page 6

page 7

page 8


Diff-ID: An Explainable Identity Difference Quantification Framework for DeepFake Detection

Despite the fact that DeepFake forgery detection algorithms have achieve...

Privacy-Aware Identity Cloning Detection based on Deep Forest

We propose a novel method to detect identity cloning of social-sensor cl...

Protecting Celebrities with Identity Consistency Transformer

In this work we propose Identity Consistency Transformer, a novel face f...

Deepfake Caricatures: Amplifying attention to artifacts increases deepfake detection by humans and machines

Deepfakes pose a serious threat to our digital society by fueling the sp...

Identity Encoder for Personalized Diffusion

Many applications can benefit from personalized image generation models,...

A Method of Fluorescent Fibers Detection on Identity Documents under Ultraviolet Light

In this work we consider the problem of the fluorescent security fibers ...

A Spatio-Temporal Identity Verification Method for Person-Action Instance Search in Movies

As one of the challenging problems in video search, Person-Action Instan...

Please sign up or login with your details

Forgot password? Click here to reset