Text Understanding with the Attention Sum Reader Network

03/04/2016
by   Rudolf Kadlec, et al.
0

Several large cloze-style context-question-answer datasets have been introduced recently: the CNN and Daily Mail news data and the Children's Book Test. Thanks to the size of these datasets, the associated text comprehension task is well suited for deep-learning techniques that currently seem to outperform all alternative approaches. We present a new, simple model that uses attention to directly pick the answer from the context as opposed to computing the answer using a blended representation of words in the document as is usual in similar models. This makes the model particularly suitable for question-answering problems where the answer is a single word from the document. Ensemble of our models sets new state of the art on all evaluated datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/18/2017

SearchQA: A New Q&A Dataset Augmented with Context from a Search Engine

We publicly release a new large-scale dataset, called SearchQA, for mach...
research
06/07/2016

Iterative Alternating Neural Attention for Machine Reading

We propose a novel neural attention architecture to tackle machine compr...
research
09/06/2018

Dual Ask-Answer Network for Machine Reading Comprehension

There are three modalities in the reading comprehension setting: questio...
research
05/26/2018

Dependent Gated Reading for Cloze-Style Question Answering

We present a novel deep learning architecture to address the cloze-style...
research
03/29/2016

A Parallel-Hierarchical Model for Machine Comprehension on Sparse Data

Understanding unstructured text is a major goal within natural language ...
research
09/16/2022

ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots

We present a new task and dataset, ScreenQA, for screen content understa...
research
06/05/2016

Gated-Attention Readers for Text Comprehension

In this paper we study the problem of answering cloze-style questions ov...

Please sign up or login with your details

Forgot password? Click here to reset