Beyond the Spectrum: Detecting Deepfakes via Re-Synthesis

05/29/2021
by   Yang He, et al.
0

The rapid advances in deep generative models over the past years have led to highly realistic media, known as deepfakes, that are commonly indistinguishable from real to human eyes. These advances make assessing the authenticity of visual data increasingly difficult and pose a misinformation threat to the trustworthiness of visual content in general. Although recent work has shown strong detection accuracy of such deepfakes, the success largely relies on identifying frequency artifacts in the generated images, which will not yield a sustainable detection approach as generative models continue evolving and closing the gap to real images. In order to overcome this issue, we propose a novel fake detection that is designed to re-synthesize testing images and extract visual cues for detection. The re-synthesis procedure is flexible, allowing us to incorporate a series of visual tasks - we adopt super-resolution, denoising and colorization as the re-synthesis. We demonstrate the improved effectiveness, cross-GAN generalization, and robustness against perturbations of our approach in a variety of detection scenarios involving multiple generators over CelebA-HQ, FFHQ, and LSUN datasets. Source code is available at https://github.com/SSAW14/BeyondtheSpectrum.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

page 4

page 6

page 7

12/05/2020

Spectral Distribution aware Image Generation

Recent advances in deep generative models for photo-realistic images hav...
11/21/2021

Video Content Swapping Using GAN

Video generation is an interesting problem in computer vision. It is qui...
10/04/2021

An Experimental Evaluation on Deepfake Detection using Deep Face Recognition

Significant advances in deep learning have obtained hallmark accuracy ra...
07/16/2021

A comparative study of stochastic and deep generative models for multisite precipitation synthesis

Future climate change scenarios are usually hypothesized using simulatio...
12/16/2020

Responsible Disclosure of Generative Models Using Scalable Fingerprinting

Over the past six years, deep generative models have achieved a qualitat...
11/02/2019

Unmasking DeepFakes with simple Features

Deep generative models have recently achieved impressive results for man...
09/28/2021

VoiceFixer: Toward General Speech Restoration with Neural Vocoder

Speech restoration aims to remove distortions in speech signals. Prior m...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.