DeepAI AI Chat
Log In Sign Up

DeepFake Detection with Inconsistent Head Poses: Reproducibility and Analysis

08/28/2021
by   Kevin Lutz, et al.
Naval Postgraduate School
2

Applications of deep learning to synthetic media generation allow the creation of convincing forgeries, called DeepFakes, with limited technical expertise. DeepFake detection is an increasingly active research area. In this paper, we analyze an existing DeepFake detection technique based on head pose estimation, which can be applied when fake images are generated with an autoencoder-based face swap. Existing literature suggests that this method is an effective DeepFake detector, and its motivating principles are attractively simple. With an eye towards using these principles to develop new DeepFake detectors, we conduct a reproducibility study of the existing method. We conclude that its merits are dramatically overstated, despite its celebrated status. By investigating this discrepancy we uncover a number of important and generalizable insights related to facial landmark detection, identity-agnostic head pose estimation, and algorithmic bias in DeepFake detectors. Our results correct the current literature's perception of state of the art performance for DeepFake detection.

READ FULL TEXT

page 4

page 5

page 8

09/23/2017

Simultaneous Facial Landmark Detection, Pose and Deformation Estimation under Facial Occlusion

Facial landmark detection, head pose estimation, and facial deformation ...
04/14/2020

Deep Entwined Learning Head Pose and Face Alignment Inside an Attentional Cascade with Doubly-Conditional fusion

Head pose estimation and face alignment constitute a backbone preprocess...
12/03/2018

Nose, eyes and ears: Head pose estimation by locating facial keypoints

Monocular head pose estimation requires learning a model that computes t...
04/16/2020

DeepFakes Evolution: Analysis of Facial Regions and Fake Detection Performance

Media forensics has attracted a lot of attention in the last years in pa...
10/21/2021

MOS: A Low Latency and Lightweight Framework for Face Detection, Landmark Localization, and Head Pose Estimation

With the emergence of service robots and surveillance cameras, dynamic f...
11/02/2021

HHP-Net: A light Heteroscedastic neural network for Head Pose estimation with uncertainty

In this paper we introduce a novel method to estimate the head pose of p...
09/21/2021

Finding Facial Forgery Artifacts with Parts-Based Detectors

Manipulated videos, especially those where the identity of an individual...