FDFtNet: Facing Off Fake Images using Fake Detection Fine-tuning Network

01/05/2020
by   Hyeonseong Jeon, et al.
0

Creating fake images and videos such as "Deepfake" has become much easier these days due to the advancement in Generative Adversarial Networks (GANs). Moreover, recent research such as the few-shot learning can create highly realistic personalized fake images with only a few images. Therefore, the threat of Deepfake to be used for a variety of malicious intents such as propagating fake images and videos becomes prevalent. And detecting these machine-generated fake images has been quite challenging than ever. In this work, we propose a light-weight robust fine-tuning neural network-based classifier architecture called Fake Detection Fine-tuning Network (FDFtNet), which is capable of detecting many of the new fake face image generation models, and can be easily combined with existing image classification networks and finetuned on a few datasets. In contrast to many existing methods, our approach aims to reuse popular pre-trained models with only a few images for fine-tuning to effectively detect fake images. The core of our approach is to introduce an image-based self-attention module called Fine-Tune Transformer that uses only the attention module and the down-sampling layer. This module is added to the pre-trained model and fine-tuned on a few data to search for new sets of feature space to detect fake images. We experiment with our FDFtNet on the GANsbased dataset (Progressive Growing GAN) and Deepfake-based dataset (Deepfake and Face2Face) with a small input image resolution of 64x64 that complicates detection. Our FDFtNet achieves an overall accuracy of 90.29 detecting fake images generated from the GANs-based dataset, outperforming the state-of-the-art.

READ FULL TEXT
research
12/22/2021

DA-FDFtNet: Dual Attention Fake Detection Fine-tuning Network to Detect Various AI-Generated Fake Images

Due to the advancement of Generative Adversarial Networks (GAN), Autoenc...
research
02/20/2023

Towards Universal Fake Image Detectors that Generalize Across Generative Models

With generative models proliferating at a rapid rate, there is a growing...
research
03/15/2019

Detecting GAN generated Fake Images using Co-occurrence Matrices

The advent of Generative Adversarial Networks (GANs) has brought about c...
research
10/01/2022

Evaluation of Pre-Trained CNN Models for Geographic Fake Image Detection

Thanks to the remarkable advances in generative adversarial networks (GA...
research
08/23/2022

DepthFake: a depth-based strategy for detecting Deepfake videos

Fake content has grown at an incredible rate over the past few years. Th...
research
01/28/2022

Detection of fake faces in videos

: Deep learning methodologies have been used to create applications that...
research
06/17/2022

SOS: Score-based Oversampling for Tabular Data

Score-based generative models (SGMs) are a recent breakthrough in genera...

Please sign up or login with your details

Forgot password? Click here to reset