Twin identification over viewpoint change: A deep convolutional neural network surpasses humans

07/12/2022
by   Connor J. Parde, et al.
1

Deep convolutional neural networks (DCNNs) have achieved human-level accuracy in face identification (Phillips et al., 2018), though it is unclear how accurately they discriminate highly-similar faces. Here, humans and a DCNN performed a challenging face-identity matching task that included identical twins. Participants (N=87) viewed pairs of face images of three types: same-identity, general imposter pairs (different identities from similar demographic groups), and twin imposter pairs (identical twin siblings). The task was to determine whether the pairs showed the same person or different people. Identity comparisons were tested in three viewpoint-disparity conditions: frontal to frontal, frontal to 45-degree profile, and frontal to 90-degree profile. Accuracy for discriminating matched-identity pairs from twin-imposters and general imposters was assessed in each viewpoint-disparity condition. Humans were more accurate for general-imposter pairs than twin-imposter pairs, and accuracy declined with increased viewpoint disparity between the images in a pair. A DCNN trained for face identification (Ranjan et al., 2018) was tested on the same image pairs presented to humans. Machine performance mirrored the pattern of human accuracy, but with performance at or above all humans in all but one condition. Human and machine similarity scores were compared across all image-pair types. This item-level analysis showed that human and machine similarity ratings correlated significantly in six of nine image-pair types [range r=0.38 to r=0.63], suggesting general accord between the perception of face similarity by humans and the DCNN. These findings also contribute to our understanding of DCNN performance for discriminating high-resemblance faces, demonstrate that the DCNN performs at a level at or above humans, and suggest a degree of parity between the features used by humans and the DCNN.

READ FULL TEXT

page 5

page 7

research
04/26/2022

The Influence of the Other-Race Effect on Susceptibility to Face Morphing Attacks

Facial morphs created between two identities resemble both of the faces ...
research
12/28/2018

Deep Convolutional Neural Networks in the Face of Caricature: Identity and Image Revealed

Real-world face recognition requires an ability to perceive the unique f...
research
02/14/2020

Single Unit Status in Deep Convolutional Neural Network Codes for Face Identification: Sparseness Redefined

Deep convolutional neural networks (DCNNs) trained for face identificati...
research
03/05/2018

Totally Looks Like - How Humans Compare, Compared to Machines

Perceptual judgment of image similarity by humans relies on a rich inter...
research
04/08/2020

Convolutional neural net face recognition works in non-human-like ways

Convolutional neural networks (CNNs) give state of the art performance i...
research
08/25/2022

Benchmarking Human Face Similarity Using Identical Twins

The problem of distinguishing identical twins and non-twin look-alikes i...
research
12/07/2021

DeepFace-EMD: Re-ranking Using Patch-wise Earth Mover's Distance Improves Out-Of-Distribution Face Identification

Face identification (FI) is ubiquitous and drives many high-stake decisi...

Please sign up or login with your details

Forgot password? Click here to reset