Dimensional Modeling of Emotions in Text with Appraisal Theories: Corpus Creation, Annotation Reliability, and Prediction

06/10/2022
by   Enrica Troiano, et al.
0

The most prominent tasks in emotion analysis are to assign emotions to texts and to understand how emotions manifest in language. An important observation for natural language processing is that emotions can be communicated implicitly by referring to events alone, appealing to an empathetic, intersubjective understanding of events, even without explicitly mentioning an emotion name. In psychology, the class of emotion theories known as appraisal theories aims at explaining the link between events and emotions. Appraisals can be formalized as variables that measure a cognitive evaluation by people living through an event that they consider relevant. They include the assessment if an event is novel, if the person considers themselves to be responsible, if it is in line with the own goals, and many others. Such appraisals explain which emotions are developed based on an event, e.g., that a novel situation can induce surprise or one with uncertain consequences could evoke fear. We analyze the suitability of appraisal theories for emotion analysis in text with the goal of understanding if appraisal concepts can reliably be reconstructed by annotators, if they can be predicted by text classifiers, and if appraisal concepts help to identify emotion categories. To achieve that, we compile a corpus by asking people to textually describe events that triggered particular emotions and to disclose their appraisals. Then, we ask readers to reconstruct emotions and appraisals from the text. This setup allows us to measure if emotions and appraisals can be recovered purely from text and provides a human baseline to judge model's performance measures. Our comparison of text classification methods to human annotators shows that both can reliably detect emotions and appraisals with similar performance. We further show that appraisal concepts improve the categorization of emotions in text.

READ FULL TEXT

page 7

page 30

page 31

research
09/05/2023

Bridging Emotion Role Labeling and Appraisal-based Emotion Analysis

The term emotion analysis in text subsumes various natural language proc...
research
02/25/2021

Emotion-Aware, Emotion-Agnostic, or Automatic: Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations

Appraisal theories explain how the cognitive evaluation of an event lead...
research
07/26/2023

Affective Natural Language Generation of Event Descriptions through Fine-grained Appraisal Conditions

Models for affective text generation have shown a remarkable progress, b...
research
08/31/2017

Linguistic Reflexes of Well-Being and Happiness in Echo

Different theories posit different sources for feelings of well-being an...
research
03/31/2020

Appraisal Theories for Emotion Classification in Text

Automatic emotion categorization has been predominantly formulated as te...
research
07/24/2018

A Temporal Difference Reinforcement Learning Theory of Emotion: unifying emotion, cognition and adaptive behavior

Emotions are intimately tied to motivation and the adaptation of behavio...
research
08/22/2018

Finding Good Representations of Emotions for Text Classification

It is important for machines to interpret human emotions properly for be...

Please sign up or login with your details

Forgot password? Click here to reset