mAnI: Movie Amalgamation using Neural Imitation

08/16/2017
by   Naveen Panwar, et al.
0

Cross-modal data retrieval has been the basis of various creative tasks performed by Artificial Intelligence (AI). One such highly challenging task for AI is to convert a book into its corresponding movie, which most of the creative film makers do as of today. In this research, we take the first step towards it by visualizing the content of a book using its corresponding movie visuals. Given a set of sentences from a book or even a fan-fiction written in the same universe, we employ deep learning models to visualize the input by stitching together relevant frames from the movie. We studied and compared three different types of setting to match the book with the movie content: (i) Dialog model: using only the dialog from the movie, (ii) Visual model: using only the visual content from the movie, and (iii) Hybrid model: using the dialog and the visual content from the movie. Experiments on the publicly available MovieBook dataset shows the effectiveness of the proposed models.

READ FULL TEXT

page 2

page 4

page 5

page 6

page 7

research
10/18/2019

Movienet: A Movie Multilayer Network Model using Visual and Textual Semantic Cues

Discovering content and stories in movies is one of the most important c...
research
06/22/2015

Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Books

Books are a rich source of both fine-grained information, how a characte...
research
04/15/2022

Improving Cross-Modal Understanding in Visual Dialog via Contrastive Learning

Visual Dialog is a challenging vision-language task since the visual dia...
research
04/25/2018

Movie Question Answering: Remembering the Textual Cues for Layered Visual Contents

Movies provide us with a mass of visual content as well as attracting st...
research
12/01/2021

A Comprehensive Study on Various Statistical Techniques for Prediction of Movie Success

The film industry is one of the most popular entertainment industries an...
research
09/14/2021

Multilevel profiling of situation and dialogue-based deep networks for movie genre classification using movie trailers

Automated movie genre classification has emerged as an active and essent...
research
08/19/2020

Victim or Perpetrator? Analysis of Violent Characters Portrayals from Movie Scripts

Violent content in the media can influence viewers' perception of the so...

Please sign up or login with your details

Forgot password? Click here to reset