Data Leakage and Evaluation Issues in Micro-Expression Analysis

11/21/2022
by   Tuomas Varanka, et al.
0

Micro-expressions have drawn increasing interest lately due to various potential applications. The task is, however, difficult as it incorporates many challenges from the fields of computer vision, machine learning and emotional sciences. Due to the spontaneous and subtle characteristics of micro-expressions, the available training and testing data are limited, which make evaluation complex. We show that data leakage and fragmented evaluation protocols are issues among the micro-expression literature. We find that fixing data leaks can drastically reduce model performance, in some cases even making the models perform similarly to a random classifier. To this end, we go through common pitfalls, propose a new standardized evaluation protocol using facial action units with over 2000 micro-expression samples, and provide an open source library that implements the evaluation protocols in a standardized manner. Code will be available in <https://github.com/tvaranka/meb>.

READ FULL TEXT

page 2

page 5

page 13

research
12/21/2020

An Overview of Facial Micro-Expression Analysis: Data, Methodology and Challenge

Facial micro-expressions indicate brief and subtle facial movements that...
research
10/08/2017

Micro-Expression Spotting: A Benchmark

Micro-expressions are rapid and involuntary facial expressions, which in...
research
04/06/2023

Micron-BERT: BERT-based Facial Micro-Expression Recognition

Micro-expression recognition is one of the most challenging topics in af...
research
08/08/2023

Facial Prior Based First Order Motion Model for Micro-expression Generation

Spotting facial micro-expression from videos finds various potential app...
research
05/07/2018

A Review on Facial Micro-Expressions Analysis: Datasets, Features and Metrics

Facial micro-expressions are very brief, spontaneous facial expressions ...
research
12/03/2021

Action Units That Constitute Trainable Micro-expressions (and A Large-scale Synthetic Dataset)

Due to the expensive data collection process, micro-expression datasets ...
research
07/24/2020

Micro-expression spotting: A new benchmark

Micro-expressions (MEs) are brief and involuntary facial expressions tha...

Please sign up or login with your details

Forgot password? Click here to reset