An Attention Model for group-level emotion recognition

07/09/2018
by   Aarush Gupta, et al.
0

In this paper we propose a new approach for classifying the global emotion of images containing groups of people. To achieve this task, we consider two different and complementary sources of information: i) a global representation of the entire image (ii) a local representation where only faces are considered. While the global representation of the image is learned with a convolutional neural network (CNN), the local representation is obtained by merging face features through an attention mechanism. The two representations are first learned independently with two separate CNN branches and then fused through concatenation in order to obtain the final group-emotion classifier. For our submission to the EmotiW 2018 group-level emotion recognition challenge, we combine several variations of the proposed model into an ensemble, obtaining a final accuracy of 64.83 among all challenge participants.

READ FULL TEXT
research
09/17/2017

Group Affect Prediction Using Emotion Heatmaps and Scene Information

In this paper, we describe our work on emotion detection for a group of ...
research
09/06/2017

Group-level Emotion Recognition using Transfer Learning from Face Identification

In this paper, we describe our algorithmic approach, which was used for ...
research
05/03/2019

Group Emotion Recognition Using Machine Learning

Automatic facial emotion recognition is a challenging task that has gain...
research
10/02/2019

Automatic Group Cohesiveness Detection With Multi-modal Features

Group cohesiveness is a compelling and often studied composition in grou...
research
09/15/2020

Group-Level Emotion Recognition Using a Unimodal Privacy-Safe Non-Individual Approach

This article presents our unimodal privacy-safe and non-individual propo...
research
03/09/2023

hierarchical network with decoupled knowledge distillation for speech emotion recognition

The goal of Speech Emotion Recognition (SER) is to enable computers to r...
research
12/31/2018

Predicting Group Cohesiveness in Images

Cohesiveness of a group is an essential indicator of emotional state, st...

Please sign up or login with your details

Forgot password? Click here to reset