Learning Pairwise Interaction for Generalizable DeepFake Detection

02/26/2023
by   Ying Xu, et al.
0

A fast-paced development of DeepFake generation techniques challenge the detection schemes designed for known type DeepFakes. A reliable Deepfake detection approach must be agnostic to generation types, which can present diverse quality and appearance. Limited generalizability across different generation schemes will restrict the wide-scale deployment of detectors if they fail to handle unseen attacks in an open set scenario. We propose a new approach, Multi-Channel Xception Attention Pairwise Interaction (MCX-API), that exploits the power of pairwise learning and complementary information from different color space representations in a fine-grained manner. We first validate our idea on a publicly available dataset in a intra-class setting (closed set) with four different Deepfake schemes. Further, we report all the results using balanced-open-set-classification (BOSC) accuracy in an inter-class setting (open-set) using three public datasets. Our experiments indicate that our proposed method can generalize better than the state-of-the-art Deepfakes detectors. We obtain 98.48 FF++ dataset and 90.87 promising direction for generalization of DeepFake detection. We further utilize t-SNE and attention maps to interpret and visualize the decision-making process of our proposed network. https://github.com/xuyingzhongguo/MCX-API

READ FULL TEXT

page 1

page 3

page 7

page 8

page 12

research
03/20/2023

Cascading Hierarchical Networks with Multi-task Balanced Loss for Fine-grained hashing

With the explosive growth in the number of fine-grained images in the In...
research
11/30/2018

Large-Scale and Fine-Grained Evaluation of Popular JPEG Forgery Localization Schemes

Over the years, researchers have proposed various approaches to JPEG for...
research
07/06/2018

Adversarial Learning for Fine-grained Image Search

Fine-grained image search is still a challenging problem due to the diff...
research
07/11/2020

Anomaly Detection-Based Unknown Face Presentation Attack Detection

Anomaly detection-based spoof attack detection is a recent development i...
research
02/24/2020

Learning Attentive Pairwise Interaction for Fine-Grained Classification

Fine-grained classification is a challenging problem, due to subtle diff...
research
07/05/2018

Open Logo Detection Challenge

Existing logo detection benchmarks consider artificial deployment scenar...

Please sign up or login with your details

Forgot password? Click here to reset