Assessing Performance and Fairness Metrics in Face Recognition - Bootstrap Methods

11/14/2022
by   Jean-Rémy Conti, et al.
0

The ROC curve is the major tool for assessing not only the performance but also the fairness properties of a similarity scoring function in Face Recognition. In order to draw reliable conclusions based on empirical ROC analysis, evaluating accurately the uncertainty related to statistical versions of the ROC curves of interest is necessary. For this purpose, we explain in this paper that, because the True/False Acceptance Rates are of the form of U-statistics in the case of similarity scoring, the naive bootstrap approach is not valid here and that a dedicated recentering technique must be used instead. This is illustrated on real data of face images, when applied to several ROC-based metrics such as popular fairness metrics.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/08/2022

Fair SA: Sensitivity Analysis for Fairness in Face Recognition

As the use of deep learning in high impact domains becomes ubiquitous, i...
research
03/09/2022

Evaluating Proposed Fairness Models for Face Recognition Algorithms

The development of face recognition algorithms by academic and commercia...
research
09/06/2021

Does Melania Trump have a body double from the perspective of automatic face recognition?

In this paper, we explore whether automatic face recognition can help in...
research
11/17/2021

Fairness Testing of Deep Image Classification with Adequacy Metrics

As deep image classification applications, e.g., face recognition, becom...
research
10/18/2022

On the Importance of Architectures and Hyperparameters for Fairness in Face Recognition

Face recognition systems are deployed across the world by government age...
research
11/24/2021

Multiplier bootstrap for Bures-Wasserstein barycenters

Bures-Wasserstein barycenter is a popular and promising tool in analysis...
research
10/31/2021

Hierarchical Decision Ensembles- An inferential framework for uncertain Human-AI collaboration in forensic examinations

Forensic examination of evidence like firearms and toolmarks, traditiona...

Please sign up or login with your details

Forgot password? Click here to reset