Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forward

02/25/2021
by   Momina Masood, et al.
83

Easy access to audio-visual content on social media, combined with the availability of modern tools such as Tensorflow or Keras, open-source trained models, and economical computing infrastructure, and the rapid evolution of deep-learning (DL) methods, especially Generative Adversarial Networks (GAN), have made it possible to generate deepfakes to disseminate disinformation, revenge porn, financial frauds, hoaxes, and to disrupt government functioning. The existing surveys have mainly focused on deepfake video detection only. No attempt has been made to review approaches for detection and generation of both audio and video deepfakes. This paper provides a comprehensive review and detailed analysis of existing tools and machine learning (ML) based approaches for deepfake generation and the methodologies used to detect such manipulations for the detection and generation of both audio and video deepfakes. For each category of deepfake, we discuss information related to manipulation approaches, current public datasets, and key standards for the performance evaluation of deepfake detection techniques along with their results. Additionally, we also discuss open challenges and enumerate future directions to guide future researchers on issues that need to be considered to improve the domains of both the deepfake generation and detection. This work is expected to assist the readers in understanding the creation and detection mechanisms of deepfake, along with their current limitations and future direction.

READ FULL TEXT

page 6

page 7

page 8

page 11

page 12

page 20

11/28/2021

How Deep Are the Fakes? Focusing on Audio Deepfake: A Survey

Deepfake is content or material that is synthetically generated or manip...
09/24/2021

Next generation IEEE 802.11 Wireless Local Area Networks: Current status, future directions and open challenges

new generation of Wireless Local Area Networks (WLANs) will make its app...
08/21/2022

Deepfake: Definitions, Performance Metrics and Standards, Datasets and Benchmarks, and a Meta-Review

Recent advancements in AI, especially deep learning, have contributed to...
11/04/2020

Video Generative Adversarial Networks: A Review

With the increasing interest in the content creation field in multiple s...
04/06/2022

Open-Source Tools for Behavioral Video Analysis: Setup, Methods, and Development

Recently developed methods for video analysis, especially models for pos...
11/23/2021

A Review on Analysis and Visualization Methods for Biclustering

Recently, biclustering is one of the hot topics in bioinformatics and ta...