A System for Image Understanding using Sensemaking and Narrative

by   Zev Battad, et al.

Sensemaking and narrative are two inherently interconnected concepts about how people understand the world around them. Sensemaking is the process by which people structure and interconnect the information they encounter in the world with the knowledge and inferences they have made in the past. Narratives are important constructs that people use sensemaking to create; ones that reflect provide a more holistic account of the world than the information within any given narrative is able to alone. Both are important to how human beings parse the world, and both would be valuable for a computational system attempting to do the same. In this paper, we discuss theories of sensemaking and narrative with respect to how people build an understanding of the world based on the information they encounter, as well as the links between the fields of sensemaking and narrative research. We highlight a specific computational task, visual storytelling, whose solutions we believe can be enhanced by employing a sensemaking and narrative component. We then describe our system for visual storytelling using sensemaking and narrative and discuss examples from its current implementation.


page 2

page 10

page 13


Flexible Compositional Learning of Structured Visual Concepts

Humans are highly efficient learners, with the ability to grasp the mean...

Helping People Deal With Disinformation – A Socio-Technical Perspective

At the latest since the advent of the Internet, disinformation and consp...

Human Visual Understanding for Cognition and Manipulation -- A primer for the roboticist

Robotic research is often built on approaches that are motivated by insi...

Looking At Situationally-Induced Impairments And Disabilities (SIIDs) With People With Cognitive Brain Injury

In this document, we discuss our work into a speaker recognition to supp...

AI in arbitrary world

In order to build AI we have to create a program which copes well in an ...

The Unexpected Unexpected and the Expected Unexpected: How People's Conception of the Unexpected is Not That Unexpected

The answers people give when asked to 'think of the unexpected' for ever...

The Profiling Potential of Computer Vision and the Challenge of Computational Empiricism

Computer vision and other biometrics data science applications have comm...

Please sign up or login with your details

Forgot password? Click here to reset