Pixel-Level Face Image Quality Assessment for Explainable Face Recognition

10/21/2021
by   Philipp Terhörst, et al.
0

An essential factor to achieve high performance in face recognition systems is the quality of its samples. Since these systems are involved in various daily life there is a strong need of making face recognition processes understandable for humans. In this work, we introduce the concept of pixel-level face image quality that determines the utility of pixels in a face image for recognition. Given an arbitrary face recognition network, in this work, we propose a training-free approach to assess the pixel-level qualities of a face image. To achieve this, a model-specific quality value of the input image is estimated and used to build a sample-specific quality regression model. Based on this model, quality-based gradients are back-propagated and converted into pixel-level quality estimates. In the experiments, we qualitatively and quantitatively investigated the meaningfulness of the pixel-level qualities based on real and artificial disturbances and by comparing the explanation maps on ICAO-incompliant faces. In all scenarios, the results demonstrate that the proposed solution produces meaningful pixel-level qualities. The code is publicly available.

READ FULL TEXT

page 7

page 8

page 13

page 14

page 15

page 16

page 17

research
03/20/2020

SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustness

Face image quality is an important factor to enable high performance fac...
research
06/10/2020

Agrupamento de Pixels para o Reconhecimento de Faces

This research starts with the observation that face recognition can suff...
research
06/14/2022

Pixel-by-pixel Mean Opinion Score (pMOS) for No-Reference Image Quality Assessment

Deep-learning based techniques have contributed to the remarkable progre...
research
12/02/2018

Plan-Recognition-Driven Attention Modeling for Visual Recognition

Human visual recognition of activities or external agents involves an in...
research
12/12/2019

Zooming into Face Forensics: A Pixel-level Analysis

The stunning progress in face manipulation methods has made it possible ...
research
06/28/2021

A novel approach to photon transfer conversion gain estimation

Nonuniformities in the imaging characteristics of modern image sensors a...
research
04/03/2019

FaceQnet: Quality Assessment for Face Recognition based on Deep Learning

In this paper we develop a Quality Assessment approach for face recognit...

Please sign up or login with your details

Forgot password? Click here to reset