A Fair and Comprehensive Comparison of Multimodal Tweet Sentiment Analysis Methods

by   Gullal S. Cheema, et al.

Opinion and sentiment analysis is a vital task to characterize subjective information in social media posts. In this paper, we present a comprehensive experimental evaluation and comparison with six state-of-the-art methods, from which we have re-implemented one of them. In addition, we investigate different textual and visual feature embeddings that cover different aspects of the content, as well as the recently introduced multimodal CLIP embeddings. Experimental results are presented for two different publicly available benchmark datasets of tweets and corresponding images. In contrast to the evaluation methodology of previous work, we introduce a reproducible and fair evaluation scheme to make results comparable. Finally, we conduct an error analysis to outline the limitations of the methods and possibilities for the future work.



page 6

page 7


An AutoML-based Approach to Multimodal Image Sentiment Analysis

Sentiment analysis is a research topic focused on analysing data to extr...

A Novel Context-Aware Multimodal Framework for Persian Sentiment Analysis

Most recent works on sentiment analysis have exploited the text modality...

Superpixels: An Evaluation of the State-of-the-Art

Superpixels group perceptually similar pixels to create visually meaning...

Multimodal Sentiment Analysis: Addressing Key Issues and Setting up Baselines

Sentiment analysis is proven to be very useful tool in many applications...

Supervised Video Summarization via Multiple Feature Sets with Parallel Attention

The assignment of importance scores to particular frames or (short) segm...

OutdoorSent: Can Semantic Features Help Deep Learning in Sentiment Analysis of Outdoor Images?

Opinion mining in outdoor images posted by users during day-to-day or le...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.