Consistency and Accuracy of CelebA Attribute Values

10/13/2022
by   Haiyu Wu, et al.
0

We report the first analysis of the experimental foundations of facial attribute classification. An experiment with two annotators independently assigning values shows that only 12 of 40 commonly-used attributes are assigned values with >= 95 oval face) have random consistency (50 face attributes currently used in this research area could re-focused to be more objective. We identify 5,068 duplicate face appearances in CelebA, the most widely used dataset in this research area, and find that individual attributes have contradicting values on from 10 to 860 of 5,068 duplicates. Manual audit of a subset of CelebA estimates error rates as high as 40 beard=false), even though the labeling consistency experiment indicates that no beard could be assigned with >= 95 open (MSO) attribute for deeper analysis, we estimate the error rate for (MSO=true) at about 20 version of the MSO attribute values, and compare classification models created using the original versus corrected values. The corrected values enable a model that achieves higher accuracy than has been previously reported for MSO. Also, ScoreCAM visualizations show that the model created using the corrected attribute values is in fact more focused on the mouth region of the face. These results show that the error rate in the current CelebA attribute values should be reduced in order to enable learning of better models. The corrected attribute values for CelebA's MSO and the CelebA facial hair attributes will be made available upon publication.

READ FULL TEXT

page 6

page 11

page 12

page 13

page 14

page 15

page 16

page 17

research
02/22/2023

Logical Consistency and Greater Descriptive Power for Facial Hair Attribute Learning

Face attribute research has so far used only simple binary attributes fo...
research
12/26/2018

A Survey to Deep Facial Attribute Analysis

Facial attribute analysis has received considerable attention with the d...
research
12/20/2019

Controllable Face Aging

Motivated by the following two observations: 1) people are aging differe...
research
07/25/2023

Random (Un)rounding : Vulnerabilities in Discrete Attribute Disclosure in the 2021 Canadian Census

The 2021 Canadian census is notable for using a unique form of privacy, ...
research
09/12/2017

A Deep Cascade Network for Unaligned Face Attribute Classification

Humans focus attention on different face regions when recognizing face a...
research
10/25/2022

ASD: Towards Attribute Spatial Decomposition for Prior-Free Facial Attribute Recognition

Representing the spatial properties of facial attributes is a vital chal...
research
05/28/2019

Constructing High Precision Knowledge Bases with Subjective and Factual Attributes

Knowledge bases (KBs) are the backbone of many ubiquitous applications a...

Please sign up or login with your details

Forgot password? Click here to reset