When Saliency Meets Sentiment: Understanding How Image Content Invokes Emotion and Sentiment

11/14/2016
by   Honglin Zheng, et al.
0

Sentiment analysis is crucial for extracting social signals from social media content. Due to the prevalence of images in social media, image sentiment analysis is receiving increasing attention in recent years. However, most existing systems are black-boxes that do not provide insight on how image content invokes sentiment and emotion in the viewers. Psychological studies have confirmed that salient objects in an image often invoke emotions. In this work, we investigate more fine-grained and more comprehensive interaction between visual saliency and visual sentiment. In particular, we partition images in several primary scene-type dimensions, including: open-closed, natural-manmade, indoor-outdoor, and face-noface. Using state of the art saliency detection algorithm and sentiment classification algorithm, we examine how the sentiment of the salient region(s) in an image relates to the overall sentiment of the image. The experiments on a representative image emotion dataset have shown interesting correlation between saliency and sentiment in different scene types and in turn shed light on the mechanism of visual sentiment evocation.

READ FULL TEXT

page 1

page 3

research
02/16/2021

An AutoML-based Approach to Multimodal Image Sentiment Analysis

Sentiment analysis is a research topic focused on analysing data to extr...
research
09/04/2020

Visual Sentiment Analysis from Disaster Images in Social Media

The increasing popularity of social networks and users' tendency towards...
research
04/12/2016

From Pixels to Sentiment: Fine-tuning CNNs for Visual Sentiment Prediction

Visual multimedia have become an inseparable part of our digital social ...
research
04/25/2022

Multimodal Dual Emotion with Fusion of Visual Sentiment for Rumor Detection

In recent years, rumors have had a devastating impact on society, making...
research
01/23/2023

StockEmotions: Discover Investor Emotions for Financial Sentiment Analysis and Multivariate Time Series

There has been growing interest in applying NLP techniques in the financ...
research
06/03/2019

Multi-task Pairwise Neural Ranking for Hashtag Segmentation

Hashtags are often employed on social media and beyond to add metadata t...
research
04/28/2023

The Emotions of the Crowd: Learning Image Sentiment from Tweets via Cross-modal Distillation

Trends and opinion mining in social media increasingly focus on novel in...

Please sign up or login with your details

Forgot password? Click here to reset