Plot and Rework: Modeling Storylines for Visual Storytelling

by   Chi-Yang Hsu, et al.

Writing a coherent and engaging story is not easy. Creative writers use their knowledge and worldview to put disjointed elements together to form a coherent storyline, and work and rework iteratively toward perfection. Automated visual storytelling (VIST) models, however, make poor use of external knowledge and iterative generation when attempting to create stories. This paper introduces PR-VIST, a framework that represents the input image sequence as a story graph in which it finds the best path to form a storyline. PR-VIST then takes this path and learns to generate the final story via an iterative training process. This framework produces stories that are superior in terms of diversity, coherence, and humanness, per both automatic and human evaluations. An ablation study shows that both plotting and reworking contribute to the model's superiority.


page 2

page 3

page 7

page 8


Knowledge-Enriched Visual Storytelling

Stories are diverse and highly personalized, resulting in a large possib...

Text-Only Training for Visual Storytelling

Visual storytelling aims to generate a narrative based on a sequence of ...

Visual Writing Prompts: Character-Grounded Story Generation with Curated Image Sequences

Current work on image-based story generation suffers from the fact that ...

Album Storytelling with Iterative Story-aware Captioning and Large Language Models

This work studies how to transform an album to vivid and coherent storie...

Molecumentary: Scalable Narrated Documentaries Using Molecular Visualization

We present a method for producing documentary-style content using real-t...

Heteroglossia: In-Situ Story Ideation with the Crowd

Ideation is essential for creative writing. Many authors struggle to com...

What Makes A Good Story? Designing Composite Rewards for Visual Storytelling

Previous storytelling approaches mostly focused on optimizing traditiona...

Please sign up or login with your details

Forgot password? Click here to reset