Multilevel profiling of situation and dialogue-based deep networks for movie genre classification using movie trailers

09/14/2021
by   Dinesh Kumar Vishwakarma, et al.
0

Automated movie genre classification has emerged as an active and essential area of research and exploration. Short duration movie trailers provide useful insights about the movie as video content consists of the cognitive and the affective level features. Previous approaches were focused upon either cognitive or affective content analysis. In this paper, we propose a novel multi-modality: situation, dialogue, and metadata-based movie genre classification framework that takes both cognition and affect-based features into consideration. A pre-features fusion-based framework that takes into account: situation-based features from a regular snapshot of a trailer that includes nouns and verbs providing the useful affect-based mapping with the corresponding genres, dialogue (speech) based feature from audio, metadata which together provides the relevant information for cognitive and affect based video analysis. We also develop the English movie trailer dataset (EMTD), which contains 2000 Hollywood movie trailers belonging to five popular genres: Action, Romance, Comedy, Horror, and Science Fiction, and perform cross-validation on the standard LMTD-9 dataset for validating the proposed framework. The results demonstrate that the proposed methodology for movie genre classification has performed excellently as depicted by the F1 scores, precision, recall, and area under the precision-recall curves.

READ FULL TEXT

page 6

page 9

page 11

research
08/08/2019

Moviescope: Large-scale Analysis of Movies using Multiple Modalities

Film media is a rich form of artistic expression. Unlike photography, an...
research
11/09/2017

Enhanced Movie Content Similarity Based on Textual, Auditory and Visual Information

In this paper we examine the ability of low-level multimodal features to...
research
07/12/2018

Competitive Analysis System for Theatrical Movie Releases Based on Movie Trailer Deep Video Representation

Audience discovery is an important activity at major movie studios. Deep...
research
10/18/2019

Movienet: A Movie Multilayer Network Model using Visual and Textual Semantic Cues

Discovering content and stories in movies is one of the most important c...
research
10/24/2019

A Graph-Based Framework to Bridge Movies and Synopses

Inspired by the remarkable advances in video analytics, research teams a...
research
08/16/2017

mAnI: Movie Amalgamation using Neural Imitation

Cross-modal data retrieval has been the basis of various creative tasks ...
research
09/20/2021

From None to Severe: Predicting Severity in Movie Scripts

In this paper, we introduce the task of predicting severity of age-restr...

Please sign up or login with your details

Forgot password? Click here to reset