Affective Image Content Analysis: Two Decades Review and New Perspectives

06/30/2021
by   Sicheng Zhao, et al.
0

Images can convey rich semantics and induce various emotions in viewers. Recently, with the rapid advancement of emotional intelligence and the explosive growth of visual data, extensive research efforts have been dedicated to affective image content analysis (AICA). In this survey, we will comprehensively review the development of AICA in the recent two decades, especially focusing on the state-of-the-art methods with respect to three main challenges – the affective gap, perception subjectivity, and label noise and absence. We begin with an introduction to the key emotion representation models that have been widely employed in AICA and description of available datasets for performing evaluation with quantitative comparison of label noise and dataset bias. We then summarize and compare the representative approaches on (1) emotion feature extraction, including both handcrafted and deep features, (2) learning methods on dominant emotion recognition, personalized emotion prediction, emotion distribution learning, and learning from noisy data or few labels, and (3) AICA based applications. Finally, we discuss some challenges and promising research directions in the future, such as image content and context understanding, group emotion clustering, and viewer-image interaction.

READ FULL TEXT

page 1

page 2

page 7

research
03/19/2021

Computational Emotion Analysis From Images: Recent Advances and Future Directions

Emotions are usually evoked in humans by images. Recently, extensive res...
research
08/18/2021

Emotion Recognition from Multiple Modalities: Fundamentals and Methodologies

Humans are emotional creatures. Multiple modalities are often involved w...
research
07/25/2023

Unlocking the Emotional World of Visual Media: An Overview of the Science, Research, and Impact of Understanding Emotion

The emergence of artificial emotional intelligence technology is revolut...
research
03/11/2021

Affect2MM: Affective Analysis of Multimedia Content Using Emotion Causality

We present Affect2MM, a learning method for time-series emotion predicti...
research
02/17/2022

Emotion Recognition among Couples: A Survey

Couples' relationships affect the physical health and emotional well-bei...
research
08/07/2018

Contemplating Visual Emotions: Understanding and Overcoming Dataset Bias

While machine learning approaches to visual emotion recognition offer gr...
research
07/25/2022

Seeking Subjectivity in Visual Emotion Distribution Learning

Visual Emotion Analysis (VEA), which aims to predict people's emotions t...

Please sign up or login with your details

Forgot password? Click here to reset