A Bayesian Deep Learning Framework for End-To-End Prediction of Emotion from Heartbeat

02/08/2019
by   Ross Harper, et al.
1

Automatic prediction of emotion promises to revolutionise human-computer interaction. Recent trends involve fusion of multiple modalities - audio, visual, and physiological - to classify emotional state. However, practical considerations 'in the wild' limit collection of this physiological data to commoditised heartbeat sensors. Furthermore, real-world applications often require some measure of uncertainty over model output. We present here an end-to-end deep learning model for classifying emotional valence from unimodal heartbeat data. We further propose a Bayesian framework for modelling uncertainty over valence predictions, and describe a procedure for tuning output according to varying demands on confidence. We benchmarked our framework against two established datasets within the field and achieved peak classification accuracy of 90 applications of affective computing in real-world domains such as healthcare, where a high premium is placed on non-invasive collection of data, and predictive certainty.

READ FULL TEXT

page 1

page 5

research
07/16/2019

End-To-End Prediction of Emotion From Heartbeat Data Collected by a Consumer Fitness Tracker

Automatic detection of emotion has the potential to revolutionize mental...
research
07/06/2023

A Hybrid End-to-End Spatio-Temporal Attention Neural Network with Graph-Smooth Signals for EEG Emotion Recognition

Recently, physiological data such as electroencephalography (EEG) signal...
research
11/04/2019

An Affective Situation Labeling System from Psychological Behaviors in Emotion Recognition

This paper presents a computational framework for providing affective la...
research
12/10/2019

End-to-end facial and physiological model for Affective Computing and applications

In recent years, Affective Computing and its applications have become a ...
research
08/10/2019

User independent Emotion Recognition with Residual Signal-Image Network

User independent emotion recognition with large scale physiological sign...
research
03/28/2019

A Multimodal Emotion Sensing Platform for Building Emotion-Aware Applications

Humans use a host of signals to infer the emotional state of others. In ...
research
01/17/2022

A Brief Survey of Machine Learning Methods for Emotion Prediction using Physiological Data

Emotion prediction is a key emerging research area that focuses on ident...

Please sign up or login with your details

Forgot password? Click here to reset