Towards Generalizable Deepfake Detection by Primary Region Regularization

07/24/2023
by   Harry Cheng, et al.
0

The existing deepfake detection methods have reached a bottleneck in generalizing to unseen forgeries and manipulation approaches. Based on the observation that the deepfake detectors exhibit a preference for overfitting the specific primary regions in input, this paper enhances the generalization capability from a novel regularization perspective. This can be simply achieved by augmenting the images through primary region removal, thereby preventing the detector from over-relying on data bias. Our method consists of two stages, namely the static localization for primary region maps, as well as the dynamic exploitation of primary region masks. The proposed method can be seamlessly integrated into different backbones without affecting their inference efficiency. We conduct extensive experiments over three widely used deepfake datasets - DFDC, DF-1.0, and Celeb-DF with five backbones. Our method demonstrates an average performance improvement of 6 backbones and performs competitively with several state-of-the-art baselines.

READ FULL TEXT

page 1

page 4

page 9

page 10

research
12/16/2021

Radio-Assisted Human Detection

In this paper, we propose a radio-assisted human detection framework by ...
research
03/04/2020

Mixup Regularization for Region Proposal based Object Detectors

Mixup - a neural network regularization technique based on linear interp...
research
02/01/2023

QCRS: Improve Randomized Smoothing using Quasi-Concave Optimization

Randomized smoothing is currently the state-of-the-art method that provi...
research
07/04/2022

CRFormer: A Cross-Region Transformer for Shadow Removal

Aiming to restore the original intensity of shadow regions in an image a...
research
06/30/2020

Some remarks on ideals of commutative semirings

The main purpose of this paper is to investigate the prime, primary, and...
research
11/23/2019

DCSO: Dynamic Combination of Detector Scores for Outlier Ensembles

Selecting and combining the outlier scores of different base detectors u...

Please sign up or login with your details

Forgot password? Click here to reset