Leveraging Audio Gestalt to Predict Media Memorability

12/31/2020
by   Lorin Sweeney, et al.
14

Memorability determines what evanesces into emptiness, and what worms its way into the deepest furrows of our minds. It is the key to curating more meaningful media content as we wade through daily digital torrents. The Predicting Media Memorability task in MediaEval 2020 aims to address the question of media memorability by setting the task of automatically predicting video memorability. Our approach is a multimodal deep learning-based late fusion that combines visual, semantic, and auditory features. We used audio gestalt to estimate the influence of the audio modality on overall video memorability, and accordingly inform which combination of features would best predict a given video's memorability scores.

READ FULL TEXT

page 1

page 2

page 3

research
04/23/2021

The Influence of Audio on Video Memorability with an Audio Gestalt Regulated Video Memorability System

Memories are the tethering threads that tie us to the world, and memorab...
research
02/01/2021

Multi-modal Ensemble Models for Predicting Video Memorability

Modeling media memorability has been a consistent challenge in the field...
research
04/26/2022

An Overview of Recent Work in Media Forensics: Methods and Threats

In this paper, we review recent work in media forensics for digital imag...
research
04/28/2018

A Bimodal Learning Approach to Assist Multi-sensory Effects Synchronization

In mulsemedia applications, traditional media content (text, image, audi...
research
10/17/2021

Storage and Authentication of Audio Footage for IoAuT Devices Using Distributed Ledger Technology

Detection of fabricated or manipulated audio content to prevent, e.g., d...
research
12/15/2021

Predicting Media Memorability: Comparing Visual, Textual and Auditory Features

This paper describes our approach to the Predicting Media Memorability t...
research
11/10/2019

A Multimodal CNN-based Tool to Censure Inappropriate Video Scenes

Due to the extensive use of video-sharing platforms and services for the...

Please sign up or login with your details

Forgot password? Click here to reset