DeepFake Detection Based on the Discrepancy Between the Face and its Context

08/27/2020
by   Yuval Nirkin, et al.
0

We propose a method for detecting face swapping and other identity manipulations in single images. Face swapping methods, such as DeepFake, manipulate the face region, aiming to adjust the face to the appearance of its context, while leaving the context unchanged. We show that this modus operandi produces discrepancies between the two regions. These discrepancies offer exploitable telltale signs of manipulation. Our approach involves two networks: (i) a face identification network that considers the face region bounded by a tight semantic segmentation, and (ii) a context recognition network that considers the face context (e.g., hair, ears, neck). We describe a method which uses the recognition signals from our two networks to detect such discrepancies, providing a complementary detection signal that improves conventional real vs. fake classifiers commonly used for detecting fake images. Our method achieves state of the art results on the FaceForensics++, Celeb-DF-v2, and DFDC benchmarks for face manipulation detection, and even generalizes to detect fakes produced by unseen methods.

READ FULL TEXT

page 2

page 4

page 7

page 8

research
11/17/2019

Exploiting Human Social Cognition for the Detection of Fake and Fraudulent Faces via Memory Networks

Advances in computer vision have brought us to the point where we have t...
research
09/13/2021

FaceGuard: Proactive Deepfake Detection

Existing deepfake-detection methods focus on passive detection, i.e., th...
research
12/31/2019

Face X-ray for More General Face Forgery Detection

In this paper we propose a novel image representation called face X-ray ...
research
07/13/2021

Detect and Locate: A Face Anti-Manipulation Approach with Semantic and Noise-level Supervision

The technological advancements of deep learning have enabled sophisticat...
research
11/24/2018

Generate, Segment and Replace: Towards Generic Manipulation Segmentation

It has been witnessed an emerging demand for image manipulation segmenta...
research
01/01/2020

DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detection

The free access to large-scale public databases, together with the fast ...
research
12/12/2019

Zooming into Face Forensics: A Pixel-level Analysis

The stunning progress in face manipulation methods has made it possible ...

Please sign up or login with your details

Forgot password? Click here to reset