Whodunnit? Crime Drama as a Case for Natural Language Understanding

10/31/2017
by   Lea Frermann, et al.
0

In this paper we argue that crime drama exemplified in television programs such as CSI:Crime Scene Investigation is an ideal testbed for approximating real-world natural language understanding and the complex inferences associated with it. We propose to treat crime drama as a new inference task, capitalizing on the fact that each episode poses the same basic question (i.e., who committed the crime) and naturally provides the answer when the perpetrator is revealed. We develop a new dataset based on CSI episodes, formalize perpetrator identification as a sequence labeling problem, and develop an LSTM-based model which learns from multi-modal data. Experimental results show that an incremental inference strategy is key to making accurate guesses as well as learning from representations fusing textual, visual, and acoustic input.

READ FULL TEXT

page 3

page 5

page 6

page 9

page 11

research
07/11/2019

Incrementalizing RASA's Open-Source Natural Language Understanding Pipeline

As spoken dialogue systems and chatbots are gaining more widespread adop...
research
07/01/2019

Natural Language Understanding with the Quora Question Pairs Dataset

This paper explores the task Natural Language Understanding (NLU) by loo...
research
12/10/2021

A Puzzle-Based Dataset for Natural Language Inference

We provide here a dataset for tasks related to natural language understa...
research
10/26/2022

Leveraging Affirmative Interpretations from Negation Improves Natural Language Understanding

Negation poses a challenge in many natural language understanding tasks....
research
04/18/2022

Imagination-Augmented Natural Language Understanding

Human brains integrate linguistic and perceptual information simultaneou...
research
05/24/2022

FLUTE: Figurative Language Understanding and Textual Explanations

In spite of the prevalence of figurative language, transformer-based mod...
research
03/24/2011

On Understanding and Machine Understanding

In the present paper, we try to propose a self-similar network theory fo...

Please sign up or login with your details

Forgot password? Click here to reset