Predicting Personal Traits from Facial Images using Convolutional Neural Networks Augmented with Facial Landmark Information

05/29/2016
by   Yoad Lewenberg, et al.
0

We consider the task of predicting various traits of a person given an image of their face. We estimate both objective traits, such as gender, ethnicity and hair-color; as well as subjective traits, such as the emotion a person expresses or whether he is humorous or attractive. For sizeable experimentation, we contribute a new Face Attributes Dataset (FAD), having roughly 200,000 attribute labels for the above traits, for over 10,000 facial images. Due to the recent surge of research on Deep Convolutional Neural Networks (CNNs), we begin by using a CNN architecture for estimating facial attributes and show that they indeed provide an impressive baseline performance. To further improve performance, we propose a novel approach that incorporates facial landmark information for input images as an additional channel, helping the CNN learn better attribute-specific features so that the landmarks across various training images hold correspondence. We empirically analyse the performance of our method, showing consistent improvement over the baseline across traits.

READ FULL TEXT
research
05/03/2018

Multi-task Learning of Cascaded CNN for Facial Attribute Classification

Recently, facial attribute classification (FAC) has attracted significan...
research
01/11/2019

The Deeper, the Better: Analysis of Person Attributes Recognition

In person attributes recognition, we describe a person in terms of their...
research
10/25/2016

Predicting First Impressions with Deep Learning

Describable visual facial attributes are now commonplace in human biomet...
research
07/14/2020

Face to Purchase: Predicting Consumer Choices with Structured Facial and Behavioral Traits Embedding

Predicting consumers' purchasing behaviors is critical for targeted adve...
research
04/14/2021

CelebHair: A New Large-Scale Dataset for Hairstyle Recommendation based on CelebA

In this paper, we present a new large-scale dataset for hairstyle recomm...
research
12/20/2019

Background Hardly Matters: Understanding Personality Attribution in Deep Residual Networks

Perceived personality traits attributed to an individual do not have to ...
research
04/19/2015

DEEP-CARVING: Discovering Visual Attributes by Carving Deep Neural Nets

Most of the approaches for discovering visual attributes in images deman...

Please sign up or login with your details

Forgot password? Click here to reset