Automatic Facial Skin Feature Detection for Everyone

03/30/2022
by   Qian Zheng, et al.
0

Automatic assessment and understanding of facial skin condition have several applications, including the early detection of underlying health problems, lifestyle and dietary treatment, skin-care product recommendation, etc. Selfies in the wild serve as an excellent data resource to democratize skin quality assessment, but suffer from several data collection challenges.The key to guaranteeing an accurate assessment is accurate detection of different skin features. We present an automatic facial skin feature detection method that works across a variety of skin tones and age groups for selfies in the wild. To be specific, we annotate the locations of acne, pigmentation, and wrinkle for selfie images with different skin tone colors, severity levels, and lighting conditions. The annotation is conducted in a two-phase scheme with the help of a dermatologist to train volunteers for annotation. We employ Unet++ as the network architecture for feature detection. This work shows that the two-phase annotation scheme can robustly detect the accurate locations of acne, pigmentation, and wrinkle for selfie images with different ethnicities, skin tone colors, severity levels, age groups, and lighting conditions.

READ FULL TEXT

page 2

page 3

page 4

page 5

research
04/06/2021

Towards measuring fairness in AI: the Casual Conversations dataset

This paper introduces a novel dataset to help researchers evaluate their...
research
09/07/2023

Improving the Accuracy of Beauty Product Recommendations by Assessing Face Illumination Quality

We focus on addressing the challenges in responsible beauty product reco...
research
07/18/2019

A Computer Vision Application for Assessing Facial Acne Severity from Selfie Images

We worked with Nestle Skin Health SHIELD (Skin Health, Innovation, Educa...
research
02/23/2023

Evaluating the Efficacy of Skincare Product: A Realistic Short-Term Facial Pore Simulation

Simulating the effects of skincare products on face is a potential new w...
research
04/17/2013

Automated Switching System for Skin Pixel Segmentation in Varied Lighting

In Computer Vision, colour-based spatial techniquesoften assume a static...
research
05/16/2023

Consensus and Subjectivity of Skin Tone Annotation for ML Fairness

Recent advances in computer vision fairness have relied on datasets augm...
research
01/26/2022

Estimation of Spectral Biophysical Skin Properties from Captured RGB Albedo

We present a new method to reconstruct and manipulate the spectral prope...

Please sign up or login with your details

Forgot password? Click here to reset