Domain Generalization for Document Authentication against Practical Recapturing Attacks

01/05/2021
by   Changsheng Chen, et al.
0

Recapturing attack can be employed as a simple but effective anti-forensic tool for digital document images. Inspired by the document inspection process that compares a questioned document against a reference sample, we proposed a document recapture detection scheme by employing Siamese network to compare and extract distinct features in a recapture document image. The proposed algorithm takes advantages of both metric learning and image forensic techniques. Instead of adopting Euclidean distance-based loss function, we integrate the forensic similarity function with a triplet loss and a normalized softmax loss. After training with the proposed triplet selection strategy, the resulting feature embedding clusters the genuine samples near the reference while pushes the recaptured samples apart. In the experiment, we consider practical domain generalization problems, such as the variations in printing/imaging devices, substrates, recapturing channels, and document types. To evaluate the robustness of different approaches, we benchmark some popular off-the-shelf machine learning-based approaches, a state-of-the-art document image detection scheme, and the proposed schemes with different network backbones under various experimental protocols. Experimental results show that the proposed schemes with different network backbones have consistently outperformed the state-of-the-art approaches under different experimental settings. Specifically, under the most challenging scenario in our experiment, i.e., evaluation across different types of documents that produced by different devices, we have achieved less than 5.00 Classification Error Rate) and 5.56 Classification Error Rate) by the proposed network with ResNeXt101 backbone at 5

READ FULL TEXT

page 2

page 3

research
09/05/2022

Forensicability Assessment of Questioned Images in Recapturing Detection

Recapture detection of face and document images is an important forensic...
research
02/26/2022

A Robust Document Image Watermarking Scheme using Deep Neural Network

Watermarking is an important copyright protection technology which gener...
research
02/23/2022

Deep Metric Learning-Based Semi-Supervised Regression With Alternate Learning

This paper introduces a novel deep metric learning-based semi-supervised...
research
02/01/2021

Deep Learning-based Forgery Attack on Document Images

With the ongoing popularization of online services, the digital document...
research
10/07/2021

Scale Invariant Domain Generalization Image Recapture Detection

Recapturing and rebroadcasting of images are common attack methods in in...
research
07/15/2020

Evaluation of Neural Network Classification Systems on Document Stream

One major drawback of state of the art Neural Networks (NN)-based approa...
research
05/19/2021

Light-weight Document Image Cleanup using Perceptual Loss

Smartphones have enabled effortless capturing and sharing of documents i...

Please sign up or login with your details

Forgot password? Click here to reset