Multi-Instance Dynamic Ordinal Random Fields for Weakly-supervised Facial Behavior Analysis

03/01/2018
by   Adria Ruiz, et al.
0

We propose a Multi-Instance-Learning (MIL) approach for weakly-supervised learning problems, where a training set is formed by bags (sets of feature vectors or instances) and only labels at bag-level are provided. Specifically, we consider the Multi-Instance Dynamic-Ordinal-Regression (MI-DOR) setting, where the instance labels are naturally represented as ordinal variables and bags are structured as temporal sequences. To this end, we propose Multi-Instance Dynamic Ordinal Random Fields (MI-DORF). In this framework, we treat instance-labels as temporally-dependent latent variables in an Undirected Graphical Model. Different MIL assumptions are modelled via newly introduced high-order potentials relating bag and instance-labels within the energy function of the model. We also extend our framework to address the Partially-Observed MI-DOR problems, where a subset of instance labels are available during training. We show on the tasks of weakly-supervised facial behavior analysis, Facial Action Unit (DISFA dataset) and Pain (UNBC dataset) Intensity estimation, that the proposed framework outperforms alternative learning approaches. Furthermore, we show that MIDORF can be employed to reduce the data annotation efforts in this context by large-scale.

READ FULL TEXT

page 1

page 2

page 8

page 14

page 15

research
09/06/2016

Multi-instance Dynamic Ordinal Random Fields for Weakly-Supervised Pain Intensity Estimation

In this paper, we address the Multi-Instance-Learning (MIL) problem when...
research
01/22/2013

Heteroscedastic Conditional Ordinal Random Fields for Pain Intensity Estimation from Facial Images

We propose a novel method for automatic pain intensity estimation from f...
research
09/22/2013

Multiple Instance Learning with Bag Dissimilarities

Multiple instance learning (MIL) is concerned with learning from sets (b...
research
04/06/2016

LOMo: Latent Ordinal Model for Facial Analysis in Videos

We study the problem of facial analysis in videos. We propose a novel we...
research
08/08/2016

Discriminatively Trained Latent Ordinal Model for Video Classification

We study the problem of video classification for facial analysis and hum...
research
12/11/2016

Multiple Instance Learning: A Survey of Problem Characteristics and Applications

Multiple instance learning (MIL) is a form of weakly supervised learning...
research
09/26/2013

Multiple Instance Learning by Discriminative Training of Markov Networks

We introduce a graphical framework for multiple instance learning (MIL) ...

Please sign up or login with your details

Forgot password? Click here to reset