DeepAI AI Chat
Log In Sign Up

EmoCo: Visual Analysis of Emotion Coherence in Presentation Videos

07/29/2019
by   Haipeng Zeng, et al.
Georgia Institute of Technology
The Hong Kong University of Science and Technology
5

Emotions play a key role in human communication and public presentations. Human emotions are usually expressed through multiple modalities. Therefore, exploring multimodal emotions and their coherence is of great value for understanding emotional expressions in presentations and improving presentation skills. However, manually watching and studying presentation videos is often tedious and time-consuming. There is a lack of tool support to help conduct an efficient and in-depth multi-level analysis. Thus, in this paper, we introduce EmoCo, an interactive visual analytics system to facilitate efficient analysis of emotion coherence across facial, text, and audio modalities in presentation videos. Our visualization system features a channel coherence view and a sentence clustering view that together enable users to obtain a quick overview of emotion coherence and its temporal evolution. In addition, a detail view and word view enable detailed exploration and comparison from the sentence level and word level, respectively. We thoroughly evaluate the proposed system and visualization techniques through two usage scenarios based on TED Talk videos and interviews with two domain experts. The results demonstrate the effectiveness of our system in gaining insights into emotion coherence in presentations.

READ FULL TEXT

page 1

page 5

page 8

04/19/2022

GestureLens: Visual Analysis of Gestures in Presentation Videos

Appropriate gestures can enhance message delivery and audience engagemen...
04/28/2020

Exploring the Contextual Dynamics of Multimodal Emotion Recognition in Videos

Emotional expressions form a key part of user behavior on today's digita...
04/28/2020

The Contextual Dynamics of Multimodal Emotion Recognition in Videos

Emotional expressions form a key part of user behavior on today's digita...
11/19/2018

Visual-Texual Emotion Analysis with Deep Coupled Video and Danmu Neural Networks

User emotion analysis toward videos is to automatically recognize the ge...
05/06/2021

Estimating Presentation Competence using Multimodal Nonverbal Behavioral Cues

Public speaking and presentation competence plays an essential role in m...
07/11/2018

JeSemE: A Website for Exploring Diachronic Changes in Word Meaning and Emotion

We here introduce a substantially extended version of JeSemE, a website ...