Anti-Compression Contrastive Facial Forgery Detection

02/13/2023
by   Jiajun Huang, et al.
0

Forgery facial images and videos have increased the concern of digital security. It leads to the significant development of detecting forgery data recently. However, the data, especially the videos published on the Internet, are usually compressed with lossy compression algorithms such as H.264. The compressed data could significantly degrade the performance of recent detection algorithms. The existing anti-compression algorithms focus on enhancing the performance in detecting heavily compressed data but less consider the compression adaption to the data from various compression levels. We believe creating a forgery detection model that can handle the data compressed with unknown levels is important. To enhance the performance for such models, we consider the weak compressed and strong compressed data as two views of the original data and they should have similar representation and relationships with other samples. We propose a novel anti-compression forgery detection framework by maintaining closer relations within data under different compression levels. Specifically, the algorithm measures the pair-wise similarity within data as the relations, and forcing the relations of weak and strong compressed data close to each other, thus improving the discriminate power for detecting strong compressed data. To achieve a better strong compressed data relation guided by the less compressed one, we apply video level contrastive learning for weak compressed data, which forces the model to produce similar representations within the same video and far from the negative samples. The experiment results show that the proposed algorithm could boost performance for strong compressed data while improving the accuracy rate when detecting the clean data.

READ FULL TEXT
research
03/15/2021

Metric Learning for Anti-Compression Facial Forgery Detection

Detecting facial forgery images and videos is an increasingly important ...
research
04/06/2023

Compression of enumerations and gain

We study the compressibility of enumerations, and its role in the relati...
research
11/10/2022

Impact of Video Compression on the Performance of Object Detection Systems for Surveillance Applications

This study examines the relationship between H.264 video compression and...
research
06/12/2012

Image Similarity Using Sparse Representation and Compression Distance

A new line of research uses compression methods to measure the similarit...
research
07/20/2022

Explaining Deepfake Detection by Analysing Image Matching

This paper aims to interpret how deepfake detection models learn artifac...
research
10/06/2022

Compressed Vision for Efficient Video Understanding

Experience and reasoning occur across multiple temporal scales: millisec...
research
01/30/2019

Benefiting from Duplicates of Compressed Data: Shift-Based Holographic Compression of Images

Storage systems often rely on multiple copies of the same compressed dat...

Please sign up or login with your details

Forgot password? Click here to reset