Using Inter-Sentence Diverse Beam Search to Reduce Redundancy in Visual Storytelling

05/30/2018
by   Chao-Chun Hsu, et al.
0

Visual storytelling includes two important parts: coherence between the story and images as well as the story structure. For image to text neural network models, similar images in the sequence would provide close information for story generator to obtain almost identical sentence. However, repeatedly narrating same objects or events will undermine a good story structure. In this paper, we proposed an inter-sentence diverse beam search to generate a more expressive story. Comparing to some recent models of visual storytelling task, which generate story without considering the generated sentence of the previous picture, our proposed method can avoid generating identical sentence even given a sequence of similar pictures.

READ FULL TEXT
research
05/15/2018

Stories for Images-in-Sequence by using Visual and Narrative Components

Recent research in AI is focusing towards generating narrative stories a...
research
07/18/2019

WriterForcing: Generating more interesting story endings

We study the problem of generating interesting endings for stories. Neur...
research
03/15/2018

A Simple and Effective Approach to the Story Cloze Test

In the Story Cloze Test, a system is presented with a 4-sentence prompt ...
research
01/07/2023

Visual Story Generation Based on Emotion and Keywords

Automated visual story generation aims to produce stories with correspon...
research
08/04/2021

Towards Coherent Visual Storytelling with Ordered Image Attention

We address the problem of visual storytelling, i.e., generating a story ...
research
09/15/2019

Induction and Reference of Entities in a Visual Story

We are enveloped by stories of visual interpretations in our everyday li...
research
05/28/2018

GLAC Net: GLocal Attention Cascading Networks for Multi-image Cued Story Generation

The task of multi-image cued story generation, such as visual storytelli...

Please sign up or login with your details

Forgot password? Click here to reset