"My Way of Telling a Story": Persona based Grounded Story Generation

06/14/2019
by   Shrimai Prabhumoye, et al.
0

Visual storytelling is the task of generating stories based on a sequence of images. Inspired by the recent works in neural generation focusing on controlling the form of text, this paper explores the idea of generating these stories in different personas. However, one of the main challenges of performing this task is the lack of a dataset of visual stories in different personas. Having said that, there are independent datasets for both visual storytelling and annotated sentences for various persona. In this paper we describe an approach to overcome this by getting labelled persona data from a different task and leveraging those annotations to perform persona based story generation. We inspect various ways of incorporating personality in both the encoder and the decoder representations to steer the generation in the target direction. To this end, we propose five models which are incremental extensions to the baseline model to perform the task at hand. In our experiments we use five different personas to guide the generation process. We find that the models based on our hypotheses perform better at capturing words while generating stories in the target persona.

READ FULL TEXT
research
05/15/2018

Stories for Images-in-Sequence by using Visual and Narrative Components

Recent research in AI is focusing towards generating narrative stories a...
research
07/18/2019

WriterForcing: Generating more interesting story endings

We study the problem of generating interesting endings for stories. Neur...
research
05/21/2018

Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation

We propose a hierarchically structured reinforcement learning approach t...
research
08/22/2023

StoryBench: A Multifaceted Benchmark for Continuous Story Visualization

Generating video stories from text prompts is a complex task. In additio...
research
09/21/2022

Recipe Generation from Unsegmented Cooking Videos

This paper tackles recipe generation from unsegmented cooking videos, a ...
research
02/28/2020

Metaphoric Paraphrase Generation

This work describes the task of metaphoric paraphrase generation, in whi...
research
09/15/2019

Induction and Reference of Entities in a Visual Story

We are enveloped by stories of visual interpretations in our everyday li...

Please sign up or login with your details

Forgot password? Click here to reset