Predicting Media Memorability: Comparing Visual, Textual and Auditory Features

12/15/2021
by   Lorin Sweeney, et al.
0

This paper describes our approach to the Predicting Media Memorability task in MediaEval 2021, which aims to address the question of media memorability by setting the task of automatically predicting video memorability. This year we tackle the task from a comparative standpoint, looking to gain deeper insights into each of three explored modalities, and using our results from last year's submission (2020) as a point of reference. Our best performing short-term memorability model (0.132) tested on the TRECVid2019 dataset – just like last year – was a frame based CNN that was not trained on any TRECVid data, and our best short-term memorability model (0.524) tested on the Memento10k dataset, was a Bayesian Ride Regressor fit with DenseNet121 visual features.

READ FULL TEXT

page 1

page 2

page 3

research
12/31/2020

Overview of MediaEval 2020 Predicting Media Memorability Task: What Makes a Video Memorable?

This paper describes the MediaEval 2020 Predicting Media Memorability ta...
research
12/11/2021

Overview of The MediaEval 2021 Predicting Media Memorability Task

This paper describes the MediaEval 2021 Predicting Media Memorabilitytas...
research
12/13/2022

Overview of The MediaEval 2022 Predicting Video Memorability Task

This paper describes the 5th edition of the Predicting Video Memorabilit...
research
12/31/2020

Leveraging Audio Gestalt to Predict Media Memorability

Memorability determines what evanesces into emptiness, and what worms it...
research
07/03/2018

MediaEval 2018: Predicting Media Memorability Task

In this paper, we present the Predicting Media Memorability task, which ...
research
04/08/2023

StillFast: An End-to-End Approach for Short-Term Object Interaction Anticipation

Anticipation problem has been studied considering different aspects such...
research
12/07/2022

Experiences from the MediaEval Predicting Media Memorability Task

The Predicting Media Memorability task in the MediaEval evaluation campa...

Please sign up or login with your details

Forgot password? Click here to reset