Psychophysical Evaluation of Human Performance in Detecting Digital Face Image Manipulations

01/28/2022
by   Robert Nichols, et al.
0

In recent years, increasing deployment of face recognition technology in security-critical settings, such as border control or law enforcement, has led to considerable interest in the vulnerability of face recognition systems to attacks utilising legitimate documents, which are issued on the basis of digitally manipulated face images. As automated manipulation and attack detection remains a challenging task, conventional processes with human inspectors performing identity verification remain indispensable. These circumstances merit a closer investigation of human capabilities in detecting manipulated face images, as previous work in this field is sparse and often concentrated only on specific scenarios and biometric characteristics. This work introduces a web-based, remote visual discrimination experiment on the basis of principles adopted from the field of psychophysics and subsequently discusses interdisciplinary opportunities with the aim of examining human proficiency in detecting different types of digitally manipulated face images, specifically face swapping, morphing, and retouching. In addition to analysing appropriate performance measures, a possible metric of detectability is explored. Experimental data of 306 probands indicate that detection performance is widely distributed across the population and detection of certain types of face image manipulations is much more challenging than others.

READ FULL TEXT

page 1

page 3

page 10

page 11

page 12

page 13

page 15

research
12/09/2020

Vulnerability Analysis of Face Morphing Attacks from Landmarks and Generative Adversarial Networks

Morphing attacks is a threat to biometric systems where the biometric re...
research
08/05/2022

MorDeephy: Face Morphing Detection Via Fused Classification

Face morphing attack detection (MAD) is one of the most challenging task...
research
09/01/2023

Impact of Image Context for Single Deep Learning Face Morphing Attack Detection

The increase in security concerns due to technological advancements has ...
research
03/26/2021

Focused LRP: Explainable AI for Face Morphing Attack Detection

The task of detecting morphed face images has become highly relevant in ...
research
05/02/2023

Differential Newborn Face Morphing Attack Detection using Wavelet Scatter Network

Face Recognition System (FRS) are shown to be vulnerable to morphed imag...
research
06/14/2023

An Exploratory Study of Masked Face Recognition with Machine Learning Algorithms

Automated face recognition is a widely adopted machine learning technolo...
research
07/17/2023

Identity-Preserving Aging of Face Images via Latent Diffusion Models

The performance of automated face recognition systems is inevitably impa...

Please sign up or login with your details

Forgot password? Click here to reset