Mixed Multi-Model Semantic Interaction for Graph-based Narrative Visualizations

02/13/2023
by   Brian Keith Norambuena, et al.
0

Narrative sensemaking is an essential part of understanding sequential data. Narrative maps are a visual representation model that can assist analysts to understand narratives. In this work, we present a semantic interaction (SI) framework for narrative maps that can support analysts through their sensemaking process. In contrast to traditional SI systems which rely on dimensionality reduction and work on a projection space, our approach has an additional abstraction layer – the structure space – that builds upon the projection space and encodes the narrative in a discrete structure. This extra layer introduces additional challenges that must be addressed when integrating SI with the narrative extraction pipeline. We address these challenges by presenting the general concept of Mixed Multi-Model Semantic Interaction (3MSI) – an SI pipeline, where the highest-level model corresponds to an abstract discrete structure and the lower-level models are continuous. To evaluate the performance of our 3MSI models for narrative maps, we present a quantitative simulation-based evaluation and a qualitative evaluation with case studies and expert feedback. We find that our SI system can model the analysts' intent and support incremental formalism for narrative maps.

READ FULL TEXT
research
07/31/2020

DeepVA: Bridging Cognition and Computation through Semantic Interaction and Deep Learning

This paper examines how deep learning (DL) representations, in contrast ...
research
08/13/2021

Narrative Sensemaking: Strategies for Narrative Maps Construction

Narrative sensemaking is a fundamental process to understand sequential ...
research
09/03/2020

How to evaluate data visualizations across different levels of understanding

Understanding a visualization is a multi-level process. A reader must ex...
research
05/22/2020

On the Potential of Smarter Multi-layer Maps

The most common way for robots to handle environmental information is by...
research
02/24/2020

Superoptimization of WebAssembly Bytecode

Motivated by the fast adoption of WebAssembly, we propose the first func...
research
09/10/2018

Now You're Thinking With Structures: A Concept for Structure-based Interactions with Spreadsheets

Spreadsheets are the go-to tool for computerized calculation and modelli...
research
12/22/2021

Design guidelines for narrative maps in sensemaking tasks

Narrative sensemaking is a fundamental process to understand sequential ...

Please sign up or login with your details

Forgot password? Click here to reset