Visual Saliency Maps Can Apply to Facial Expression Recognition

11/12/2018
by   Zhenyue Qin, et al.
12

Human eyes concentrate different facial regions during distinct cognitive activities. We study utilising facial visual saliency maps to classify different facial expressions into different emotions. Our results show that our novel method of merely using facial saliency maps can achieve a descent accuracy of 65%, much higher than the chance level of 1/7. Furthermore, our approach is of semi-supervision, i.e., our facial saliency maps are generated from a general saliency prediction algorithm that is not explicitly designed for face images. We also discovered that the classification accuracies of each emotional class using saliency maps demonstrate a strong positive correlation with the accuracies produced by face images. Our work implies that humans may look at different facial areas in order to perceive different emotions.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

research
08/26/2017

Facial Expression Recognition using Visual Saliency and Deep Learning

We have developed a convolutional neural network for the purpose of reco...
research
05/04/2021

Canonical Saliency Maps: Decoding Deep Face Models

As Deep Neural Network models for face processing tasks approach human-l...
research
09/04/2017

Is human face processing a feature- or pattern-based task? Evidence using a unified computational method driven by eye movements

Research on human face processing using eye movements has provided evide...
research
11/16/2018

Saliency Supervision: An Intuitive and Effective Approach for Pain Intensity Regression

Getting pain intensity from face images is an important problem in auton...
research
06/30/2010

Fuzzy Classification of Facial Component Parameters

This paper presents a novel type-2 Fuzzy logic System to define the Shap...
research
10/29/2018

Causal Inference in Nonverbal Dyadic Communication with Relevant Interval Selection and Granger Causality

Human nonverbal emotional communication in dyadic dialogs is a process o...
research
12/11/2020

Exploring Facial Expressions and Affective Domains for Parkinson Detection

Parkinson's Disease (PD) is a neurological disorder that affects facial ...

Please sign up or login with your details

Forgot password? Click here to reset