Empirically Analyzing the Effect of Dataset Biases on Deep Face Recognition Systems

by   Adam Kortylewski, et al.

It is unknown what kind of biases modern in the wild face datasets have because of their lack of annotation. A direct consequence of this is that total recognition rates alone only provide limited insight about the generalization ability of a Deep Convolutional Neural Networks (DCNNs). We propose to empirically study the effect of different types of dataset biases on the generalization ability of DCNNs. Using synthetically generated face images, we study the face recognition rate as a function of interpretable parameters such as face pose and light. The proposed method allows valuable details about the generalization performance of different DCNN architectures to be observed and compared. In our experiments, we find that: 1) Indeed, dataset bias have a significant influence on the generalization performance of DCNNs. 2) DCNNs can generalize surprisingly well to unseen illumination conditions and large sampling gaps in the pose variation. 3) We uncover a main limitation of current DCNN architectures, which is the difficulty to generalize when different identities do not share the same pose variation. 4) We demonstrate that our findings on synthetic data also apply when learning from real world data. Our face image generator is publicly available to enable the community to benchmark face recognition systems on a common ground.


page 1

page 2

page 3

page 4


Training Deep Face Recognition Systems with Synthetic Data

Recent advances in deep learning have significantly increased the perfor...

Compressed Models Decompress Race Biases: What Quantized Models Forget for Fair Face Recognition

With the ever-growing complexity of deep learning models for face recogn...

Priming Deep Neural Networks with Synthetic Faces for Enhanced Performance

Today's most successful facial image analysis systems are based on deep ...

On the use of automatically generated synthetic image datasets for benchmarking face recognition

The availability of large-scale face datasets has been key in the progre...

Recognizing Disguised Faces in the Wild

Research in face recognition has seen tremendous growth over the past co...

Probing the Effect of Selection Bias on NN Generalization with a Thought Experiment

Learned networks in the domain of visual recognition and cognition impre...

On the Cross-dataset Generalization in License Plate Recognition

Automatic License Plate Recognition (ALPR) systems have shown remarkable...

Please sign up or login with your details

Forgot password? Click here to reset