On the Limits to Multi-Modal Popularity Prediction on Instagram – A New Robust, Efficient and Explainable Baseline

04/26/2020
by   Christoffer Riis, et al.
0

The predictability of social media popularity is a topic of much scientific interest and significant practical importance. We present a new strong baseline for popularity prediction on Instagram, which is both robust and efficient to compute. The approach expands previous work by a comprehensive ablation study of the predictive power of multiple representations of the visual modality and by detailed use of explainability tools. We use transfer learning to extract visual semantics as concepts, scenes, and objects, which allows us to interpret and explain the trained model and predictions. The study is based in one million posts extracted from Instagram. We approach the problem of popularity prediction as a ranking problem, where we predict the log-normalised number of likes. Through our ablation study design, we can suggest models that outperform a previous state-of-the-art black-box method for multi-modal popularity prediction on Instagram.

READ FULL TEXT
research
12/12/2017

Sequential Prediction of Social Media Popularity with Deep Temporal Context Networks

Prediction of popularity has profound impact for social media, since it ...
research
05/26/2021

Multi-Modal Semantic Inconsistency Detection in Social Media News Posts

As computer-generated content and deepfakes make steady improvements, se...
research
02/03/2021

Unbox the Black-box for the Medical Explainable AI via Multi-modal and Multi-centre Data Fusion: A Mini-Review, Two Showcases and Beyond

Explainable Artificial Intelligence (XAI) is an emerging research topic ...
research
06/03/2023

Inconsistent Matters: A Knowledge-guided Dual-consistency Network for Multi-modal Rumor Detection

Rumor spreaders are increasingly utilizing multimedia content to attract...
research
09/24/2018

An Iterative Refinement Approach for Social Media Headline Prediction

In this study, we propose a novel iterative refinement approach to predi...
research
11/10/2020

Social-STAGE: Spatio-Temporal Multi-Modal Future Trajectory Forecast

This paper considers the problem of multi-modal future trajectory foreca...
research
05/24/2023

Multi-modal Machine Learning for Vehicle Rating Predictions Using Image, Text, and Parametric Data

Accurate vehicle rating prediction can facilitate designing and configur...

Please sign up or login with your details

Forgot password? Click here to reset