Molecumentary: Scalable Narrated Documentaries Using Molecular Visualization

11/04/2020
by   David Kouřil, et al.
0

We present a method for producing documentary-style content using real-time scientific visualization. We produce molecumentaries, i.e., molecular documentaries featuring structural models from molecular biology. We employ scalable methods instead of the rigid traditional production pipeline. Our method is motivated by the rapid evolution of interactive scientific visualization, which shows great potential in science dissemination. Without some form of explanation or guidance, however, novices and lay-persons often find it difficult to gain insights from the visualization itself. We integrate such knowledge using the verbal channel and provide it along an engaging visual presentation. To realize the synthesis of a molecumentary, we provide technical solutions along two major production steps: 1) preparing a story structure and 2) turning the story into a concrete narrative. In the first step, information about the model from heterogeneous sources is compiled into a story graph. Local knowledge is combined with remote sources to complete the story graph and enrich the final result. In the second step, a narrative, i.e., story elements presented in sequence, is synthesized using the story graph. We present a method for traversing the story graph and generating a virtual tour, using automated camera and visualization transitions. Texts written by domain experts are turned into verbal representations using text-to-speech functionality and provided as a commentary. Using the described framework we synthesize automatic fly-throughs with descriptions that mimic a manually authored documentary. Furthermore, we demonstrate a second scenario: guiding the documentary narrative by a textual input.

READ FULL TEXT

page 2

page 4

page 5

page 7

page 8

page 11

research
08/29/2017

Generating Different Story Tellings from Semantic Representations of Narrative

In order to tell stories in different voices for different audiences, in...
research
10/20/2020

Calliope: Automatic Visual Data Story Generation from a Spreadsheet

Visual data stories shown in the form of narrative visualizations such a...
research
12/06/2017

Coupling Story to Visualization: Using Textual Analysis as a Bridge Between Data and Interpretation

Online writers and journalism media are increasingly combining visualiza...
research
05/14/2021

Plot and Rework: Modeling Storylines for Visual Storytelling

Writing a coherent and engaging story is not easy. Creative writers use ...
research
12/20/2022

Narrative Visualization to Communicate Neurological Diseases

While narrative visualization has been used successfully in various appl...
research
03/08/2019

Beware of DOI! A "bibliographic detective story" of the era of digitalization

An example of inconsistencies in information provided by popular bibliog...
research
08/25/2021

Evaluating Effects of Background Stories on Graph Perception

A graph is an abstract model that represents relations among entities, f...

Please sign up or login with your details

Forgot password? Click here to reset