Self-Supervised Face Presentation Attack Detection with Dynamic Grayscale Snippets

08/27/2022
by   Usman Muhammad, et al.
0

Face presentation attack detection (PAD) plays an important role in defending face recognition systems against presentation attacks. The success of PAD largely relies on supervised learning that requires a huge number of labeled data, which is especially challenging for videos and often requires expert knowledge. To avoid the costly collection of labeled data, this paper presents a novel method for self-supervised video representation learning via motion prediction. To achieve this, we exploit the temporal consistency based on three RGB frames which are acquired at three different times in the video sequence. The obtained frames are then transformed into grayscale images where each image is specified to three different channels such as R(red), G(green), and B(blue) to form a dynamic grayscale snippet (DGS). Motivated by this, the labels are automatically generated to increase the temporal diversity based on DGS by using the different temporal lengths of the videos, which prove to be very helpful for the downstream task. Benefiting from the self-supervised nature of our method, we report the results that outperform existing methods on four public benchmark datasets, namely Replay-Attack, MSU-MFSD, CASIA-FASD, and OULU-NPU. Explainability analysis has been carried out through LIME and Grad-CAM techniques to visualize the most important features used in the DGS.

READ FULL TEXT

page 2

page 7

research
09/09/2021

Taming Self-Supervised Learning for Presentation Attack Detection: In-Image De-Folding and Out-of-Image De-Mixing

Biometric systems are vulnerable to the Presentation Attacks (PA) perfor...
research
06/18/2022

Self-Supervised Learning for Videos: A Survey

The remarkable success of deep learning in various domains relies on the...
research
03/24/2022

Self-supervised Video-centralised Transformer for Video Face Clustering

This paper presents a novel method for face clustering in videos using a...
research
09/19/2019

Self-Supervised Learning of Depth and Motion Under Photometric Inconsistency

The self-supervised learning of depth and pose from monocular sequences ...
research
08/28/2022

Face Anti-Spoofing from the Perspective of Data Sampling

Without deploying face anti-spoofing countermeasures, face recognition s...
research
01/28/2023

Deciphering the Projection Head: Representation Evaluation Self-supervised Learning

Self-supervised learning (SSL) aims to learn intrinsic features without ...
research
10/14/2019

Facial Behavior Analysis using 4D Curvature Statistics for Presentation Attack Detection

The uniqueness, complexity, and diversity of facial shapes and expressio...

Please sign up or login with your details

Forgot password? Click here to reset