Spontaneous Subtle Expression Detection and Recognition based on Facial Strain

06/09/2016
by   Sze-Teng Liong, et al.
0

Optical strain is an extension of optical flow that is capable of quantifying subtle changes on faces and representing the minute facial motion intensities at the pixel level. This is computationally essential for the relatively new field of spontaneous micro-expression, where subtle expressions can be technically challenging to pinpoint. In this paper, we present a novel method for detecting and recognizing micro-expressions by utilizing facial optical strain magnitudes to construct optical strain features and optical strain weighted features. The two sets of features are then concatenated to form the resultant feature histogram. Experiments were performed on the CASME II and SMIC databases. We demonstrate on both databases, the usefulness of optical strain information and more importantly, that our best approaches are able to outperform the original baseline results for both detection and recognition tasks. A comparison of the proposed method with other existing spatio-temporal feature extraction approaches is also presented.

READ FULL TEXT

page 5

page 9

page 10

page 11

page 18

research
04/03/2019

Evaluation of the Spatio-Temporal features and GAN for Micro-expression Recognition System

Owing to the development and advancement of artificial intelligence, num...
research
03/26/2019

Micro-expression detection in long videos using optical flow and recurrent neural networks

Facial micro-expressions are subtle and involuntary expressions that can...
research
12/15/2016

Objective Micro-Facial Movement Detection Using FACS-Based Regions and Baseline Evaluation

Micro-facial expressions are regarded as an important human behavioural ...
research
05/09/2023

RMES: Real-Time Micro-Expression Spotting Using Phase From Riesz Pyramid

Micro-expressions (MEs) are involuntary and subtle facial expressions th...
research
05/13/2020

Mean Oriented Riesz Features for Micro Expression Classification

Micro-expressions are brief and subtle facial expressions that go on and...
research
01/23/2019

A Boost in Revealing Subtle Facial Expressions: A Consolidated Eulerian Framework

Facial Micro-expression Recognition (MER) distinguishes the underlying e...
research
11/07/2020

A Multi-stream Convolutional Neural Network for Micro-expression Recognition Using Optical Flow and EVM

Micro-expression (ME) recognition plays a crucial role in a wide range o...

Please sign up or login with your details

Forgot password? Click here to reset