DeepAI AI Chat
Log In Sign Up

PASTA: A Dataset for Modeling Participant States in Narratives

07/31/2022
by   Sayontan Ghosh, et al.
United States Naval Academy
University of Maryland, Baltimore County
0

The events in a narrative can be understood as a coherent whole via the underlying states of its participants. Often, these participant states are not explicitly mentioned in the narrative, left to be filled in via common-sense or inference. A model that understands narratives should be able to infer these implicit participant states and reason about the impact of changes to these states on the narrative. To facilitate this goal, we introduce a new crowdsourced Participants States dataset, PASTA. This dataset contains valid, inferable participant states; a counterfactual perturbation to the state; and the changes to the story that would be necessary if the counterfactual was true. We introduce three state-based reasoning tasks that test for the ability to infer when a state is entailed by a story, revise a story for a counterfactual state, and to explain the most likely state change given a revised story. Our benchmarking experiments show that while today's LLMs are able to reason about states to some degree, there is a large room for improvement, suggesting potential avenues for future research.

READ FULL TEXT

page 1

page 2

page 3

page 4

09/09/2019

Counterfactual Story Reasoning and Generation

Counterfactual reasoning requires predicting how alternative events, con...
05/16/2018

Modeling Naive Psychology of Characters in Simple Commonsense Stories

Understanding a narrative requires reading between the lines and reasoni...
12/10/2021

Unsupervised Editing for Counterfactual Stories

Creating what-if stories requires reasoning about prior statements and p...
09/27/2019

Counterfactual States for Atari Agents via Generative Deep Learning

Although deep reinforcement learning agents have produced impressive res...
11/24/2012

Shadows and Headless Shadows: an Autobiographical Approach to Narrative Reasoning

The Xapagy architecture is a story-oriented cognitive system which relie...
08/19/2021

Intercept Graph: An Interactive Radial Visualization for Comparison of State Changes

State change comparison of multiple data items is often necessary in mul...
09/28/2020

Lockdown effects in US states: an artificial counterfactual approach

We adopt an artificial counterfactual approach to assess the impact of l...