Distraction-Based Neural Networks for Document Summarization

10/26/2016
by   Qian Chen, et al.
0

Distributed representation learned with neural networks has recently shown to be effective in modeling natural languages at fine granularities such as words, phrases, and even sentences. Whether and how such an approach can be extended to help model larger spans of text, e.g., documents, is intriguing, and further investigation would still be desirable. This paper aims to enhance neural network models for such a purpose. A typical problem of document-level modeling is automatic summarization, which aims to model documents in order to generate summaries. In this paper, we propose neural models to train computers not just to pay attention to specific regions and content of input documents with attention models, but also distract them to traverse between different content of a document so as to better grasp the overall meaning for summarization. Without engineering any features, we train the models on two large datasets. The models achieve the state-of-the-art performance, and they significantly benefit from the distraction modeling, particularly when input documents are long.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/20/2016

Topic Sensitive Neural Headline Generation

Neural models have recently been used in text summarization including he...
research
11/28/2016

Improving Multi-Document Summarization via Text Classification

Developed so far, multi-document summarization has reached its bottlenec...
research
11/07/2017

Extractive Multi-document Summarization Using Multilayer Networks

Huge volumes of textual information has been produced every single day. ...
research
08/06/2015

Privacy-Preserving Multi-Document Summarization

State-of-the-art extractive multi-document summarization systems are usu...
research
02/27/2018

Extractive Text Summarization using Neural Networks

Text Summarization has been an extensively studied problem. Traditional ...
research
08/23/2018

Improving Abstraction in Text Summarization

Abstractive text summarization aims to shorten long text documents into ...
research
01/21/2019

AD3: Attentive Deep Document Dater

Knowledge of the creation date of documents facilitates several tasks su...

Please sign up or login with your details

Forgot password? Click here to reset