RealSmileNet: A Deep End-To-End Network for Spontaneous and Posed Smile Recognition

10/07/2020
by   Yan Yang, et al.
0

Smiles play a vital role in the understanding of social interactions within different communities, and reveal the physical state of mind of people in both real and deceptive ways. Several methods have been proposed to recognize spontaneous and posed smiles. All follow a feature-engineering based pipeline requiring costly pre-processing steps such as manual annotation of face landmarks, tracking, segmentation of smile phases, and hand-crafted features. The resulting computation is expensive, and strongly dependent on pre-processing steps. We investigate an end-to-end deep learning model to address these problems, the first end-to-end model for spontaneous and posed smile recognition. Our fully automated model is fast and learns the feature extraction processes by training a series of convolution and ConvLSTM layer from scratch. Our experiments on four datasets demonstrate the robustness and generalization of the proposed model by achieving state-of-the-art performances.

READ FULL TEXT
research
04/13/2022

Efficient Deep Learning-based Estimation of the Vital Signs on Smartphones

Nowadays, due to the widespread use of smartphones in everyday life and ...
research
03/17/2021

Multimodal End-to-End Sparse Model for Emotion Recognition

Existing works on multimodal affective computing tasks, such as emotion ...
research
10/09/2019

Deep localization of protein structures in fluorescence microscopy images

Accurate localization of proteins from fluorescence microscopy images is...
research
10/09/2022

Less is More: Facial Landmarks can Recognize a Spontaneous Smile

Smile veracity classification is a task of interpreting social interacti...
research
09/08/2016

Ashwin: Plug-and-Play System for Machine-Human Image Annotation

We present an end-to-end machine-human image annotation system where eac...
research
06/13/2019

Hallucinating Bag-of-Words and Fisher Vector IDT terms for CNN-based Action Recognition

In this paper, we revive the use of old-fashioned handcrafted video repr...
research
06/17/2023

Persian Semantic Role Labeling Using Transfer Learning and BERT-Based Models

Semantic role labeling (SRL) is the process of detecting the predicate-a...

Please sign up or login with your details

Forgot password? Click here to reset