DeepAI AI Chat
Log In Sign Up

LOMo: Latent Ordinal Model for Facial Analysis in Videos

04/06/2016
by   Karan Sikka, et al.
0

We study the problem of facial analysis in videos. We propose a novel weakly supervised learning method that models the video event (expression, pain etc.) as a sequence of automatically mined, discriminative sub-events (eg. onset and offset phase for smile, brow lower and cheek raise for pain). The proposed model is inspired by the recent works on Multiple Instance Learning and latent SVM/HCRF- it extends such frameworks to model the ordinal or temporal aspect in the videos, approximately. We obtain consistent improvements over relevant competitive baselines on four challenging and publicly available video based facial analysis datasets for prediction of expression, clinical pain and intent in dyadic conversations. In combination with complimentary features, we report state-of-the-art results on these datasets.

READ FULL TEXT

page 7

page 8

page 12

page 13

08/08/2016

Discriminatively Trained Latent Ordinal Model for Video Classification

We study the problem of video classification for facial analysis and hum...
10/13/2015

Variable-state Latent Conditional Random Fields for Facial Expression Recognition and Action Unit Detection

Automated recognition of facial expressions of emotions, and detection o...
03/01/2018

Multi-Instance Dynamic Ordinal Random Fields for Weakly-supervised Facial Behavior Analysis

We propose a Multi-Instance-Learning (MIL) approach for weakly-supervise...
12/05/2017

Learning Pain from Action Unit Combinations: A Weakly Supervised Approach via Multiple Instance Learning

Facial pain expression is an important modality for assessing pain, espe...
09/06/2016

Multi-instance Dynamic Ordinal Random Fields for Weakly-Supervised Pain Intensity Estimation

In this paper, we address the Multi-Instance-Learning (MIL) problem when...
01/22/2013

Heteroscedastic Conditional Ordinal Random Fields for Pain Intensity Estimation from Facial Images

We propose a novel method for automatic pain intensity estimation from f...
03/17/2022

FERV39k: A Large-Scale Multi-Scene Dataset for Facial Expression Recognition in Videos

Current benchmarks for facial expression recognition (FER) mainly focus ...