Constructing Hierarchical Q A Datasets for Video Story Understanding

04/01/2019
by   Yu-Jung Heo, et al.
HONGIK UNIVERSITY
NAVER Corp.
Seoul National University
0

Video understanding is emerging as a new paradigm for studying human-like AI. Question-and-Answering (Q A) is used as a general benchmark to measure the level of intelligence for video understanding. While several previous studies have suggested datasets for video Q A tasks, they did not really incorporate story-level understanding, resulting in highly-biased and lack of variance in degree of question difficulty. In this paper, we propose a hierarchical method for building Q A datasets, i.e. hierarchical difficulty levels. We introduce three criteria for video story understanding, i.e. memory capacity, logical complexity, and DIKW (Data-Information-Knowledge-Wisdom) pyramid. We discuss how three-dimensional map constructed from these criteria can be used as a metric for evaluating the levels of intelligence relating to video story understanding.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/07/2020

DramaQA: Character-Centered Video Story Understanding with Hierarchical QA

Despite recent progress on computer vision and natural language processi...
10/27/2020

Co-attentional Transformers for Story-Based Video Understanding

Inspired by recent trends in vision and language learning, we explore ap...
10/08/2021

Toward a Human-Level Video Understanding Intelligence

We aim to develop an AI agent that can watch video clips and have a conv...
03/01/2000

Prospects for in-depth story understanding by computer

While much research on the hard problem of in-depth story understanding ...
07/21/2021

CogME: A Novel Evaluation Metric for Video Understanding Intelligence

Developing video understanding intelligence is quite challenging because...
09/10/2021

Investigation of condominium building collapse in Surfside, Florida: a video feature tracking approach

On June 24, 2021, a 12-story condominium building (Champlain Towers Sout...
04/30/2020

Modelling Suspense in Short Stories as Uncertainty Reduction over Neural Representation

Suspense is a crucial ingredient of narrative fiction, engaging readers ...

Please sign up or login with your details

Forgot password? Click here to reset