Self-supervised GAN Detector

11/12/2021
by   Yonghyun Jeong, et al.
0

Although the recent advancement in generative models brings diverse advantages to society, it can also be abused with malicious purposes, such as fraud, defamation, and fake news. To prevent such cases, vigorous research is conducted to distinguish the generated images from the real images, but challenges still remain to distinguish the unseen generated images outside of the training settings. Such limitations occur due to data dependency arising from the model's overfitting issue to the training data generated by specific GANs. To overcome this issue, we adopt a self-supervised scheme to propose a novel framework. Our proposed method is composed of the artificial fingerprint generator reconstructing the high-quality artificial fingerprints of GAN images for detailed analysis, and the GAN detector distinguishing GAN images by learning the reconstructed artificial fingerprints. To improve the generalization of the artificial fingerprint generator, we build multiple autoencoders with different numbers of upconvolution layers. With numerous ablation studies, the robust generalization of our method is validated by outperforming the generalization of the previous state-of-the-art algorithms, even without utilizing the GAN images of the training dataset.

READ FULL TEXT

page 2

page 3

research
02/07/2022

FrePGAN: Robust Deepfake Detection Using Frequency-level Perturbations

Various deepfake detectors have been proposed, but challenges still exis...
research
12/27/2022

General GAN-generated image detection by data augmentation in fingerprint domain

In this work, we investigate improving the generalizability of GAN-gener...
research
12/31/2018

Do GANs leave artificial fingerprints?

In the last few years, generative adversarial networks (GAN) have shown ...
research
05/14/2019

An Improved Self-supervised GAN via Adversarial Training

We propose to improve unconditional Generative Adversarial Networks (GAN...
research
07/16/2020

Artificial GAN Fingerprints: Rooting Deepfake Attribution in Training Data

Photorealistic image generation is progressing rapidly and has reached a...
research
06/15/2021

Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Images

State-of-the-art (SOTA) Generative Models (GMs) can synthesize photo-rea...
research
11/19/2021

The Joy of Neural Painting

Neural Painters is a class of models that follows a GAN framework to gen...

Please sign up or login with your details

Forgot password? Click here to reset