IFQA: Interpretable Face Quality Assessment

11/14/2022
by   Byungho Jo, et al.
0

Existing face restoration models have relied on general assessment metrics that do not consider the characteristics of facial regions. Recent works have therefore assessed their methods using human studies, which is not scalable and involves significant effort. This paper proposes a novel face-centric metric based on an adversarial framework where a generator simulates face restoration and a discriminator assesses image quality. Specifically, our per-pixel discriminator enables interpretable evaluation that cannot be provided by traditional metrics. Moreover, our metric emphasizes facial primary regions considering that even minor changes to the eyes, nose, and mouth significantly affect human cognition. Our face-oriented metric consistently surpasses existing general or facial image quality assessment metrics by impressive margins. We demonstrate the generalizability of the proposed strategy in various architectural designs and challenging scenarios. Interestingly, we find that our IFQA can lead to performance improvement as an objective function.

READ FULL TEXT

page 3

page 4

page 6

page 7

page 8

page 11

page 13

page 14

research
03/25/2016

Training-Free Synthesized Face Sketch Recognition Using Image Quality Assessment Metrics

Face sketch synthesis has wide applications ranging from digital enterta...
research
01/19/2021

Ambiguity of Objective Image Quality Metrics: A New Methodology for Performance Evaluation

Objective image quality metrics try to estimate the perceptual quality o...
research
03/31/2016

A ParaBoost Stereoscopic Image Quality Assessment (PBSIQA) System

The problem of stereoscopic image quality assessment, which finds applic...
research
01/03/2022

FaceQgen: Semi-Supervised Deep Learning for Face Image Quality Assessment

In this paper we develop FaceQgen, a No-Reference Quality Assessment app...
research
11/15/2022

State of the Art of Quality Assessment of Facial Images

The goal of the project "Facial Metrics for EES" is to develop, implemen...
research
04/20/2020

CatSIM: A Categorical Image Similarity Metric

We introduce CatSIM, a new similarity metric for binary and multinary tw...
research
06/11/2020

An Unsupervised Information-Theoretic Perceptual Quality Metric

Tractable models of human perception have proved to be challenging to bu...

Please sign up or login with your details

Forgot password? Click here to reset