Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detection

03/23/2022
by   Liang Chen, et al.
0

Recent studies in deepfake detection have yielded promising results when the training and testing face forgeries are from the same dataset. However, the problem remains challenging when one tries to generalize the detector to forgeries created by unseen methods in the training dataset. This work addresses the generalizable deepfake detection from a simple principle: a generalizable representation should be sensitive to diverse types of forgeries. Following this principle, we propose to enrich the "diversity" of forgeries by synthesizing augmented forgeries with a pool of forgery configurations and strengthen the "sensitivity" to the forgeries by enforcing the model to predict the forgery configurations. To effectively explore the large forgery augmentation space, we further propose to use the adversarial training strategy to dynamically synthesize the most challenging forgeries to the current model. Through extensive experiments, we show that the proposed strategies are surprisingly effective (see Figure 1), and they could achieve superior performance than the current state-of-the-art methods. Code is available at <https://github.com/liangchen527/SLADD>.

READ FULL TEXT

page 2

page 3

page 4

research
03/02/2023

Rethinking the Effect of Data Augmentation in Adversarial Contrastive Learning

Recent works have shown that self-supervised learning can achieve remark...
research
10/27/2022

Efficient and Effective Augmentation Strategy for Adversarial Training

Adversarial training of Deep Neural Networks is known to be significantl...
research
11/14/2021

Robust and Accurate Object Detection via Self-Knowledge Distillation

Object detection has achieved promising performance on clean datasets, b...
research
04/10/2023

Improved Test-Time Adaptation for Domain Generalization

The main challenge in domain generalization (DG) is to handle the distri...
research
11/18/2021

Improving Transferability of Representations via Augmentation-Aware Self-Supervision

Recent unsupervised representation learning methods have shown to be eff...
research
07/27/2023

Self-Supervised Graph Transformer for Deepfake Detection

Deepfake detection methods have shown promising results in recognizing f...
research
10/27/2021

A Geometric Perspective towards Neural Calibration via Sensitivity Decomposition

It is well known that vision classification models suffer from poor cali...

Please sign up or login with your details

Forgot password? Click here to reset