Summary Level Training of Sentence Rewriting for Abstractive Summarization

09/19/2019
by   Sanghwan Bae, et al.
0

As an attempt to combine extractive and abstractive summarization, Sentence Rewriting models adopt the strategy of extracting salient sentences from a document first and then paraphrasing the selected ones to generate a summary. However, the existing models in this framework mostly rely on sentence-level rewards or suboptimal labels, causing a mismatch between a training objective and evaluation metric. In this paper, we present a novel training signal that directly maximizes summary-level ROUGE scores through reinforcement learning. In addition, we incorporate BERT into our model, making good use of its ability on natural language understanding. In extensive experiments, we show that a combination of our proposed model and training procedure obtains new state-of-the-art performance on both CNN/Daily Mail and New York Times datasets. We also demonstrate that it generalizes better on DUC-2002 test set.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/19/2020

Fact-level Extractive Summarization with Hierarchical Graph Mask on BERT

Most current extractive summarization models generate summaries by selec...
research
05/28/2018

Fast Abstractive Summarization with Reinforce-Selected Sentence Rewriting

Inspired by how humans summarize long documents, we propose an accurate ...
research
05/02/2023

DiffuSum: Generation Enhanced Extractive Summarization with Diffusion

Extractive summarization aims to form a summary by directly extracting s...
research
11/06/2018

DeepChannel: Salience Estimation by Contrastive Learning for Extractive Document Summarization

We propose DeepChannel, a robust, data-efficient, and interpretable neur...
research
09/29/2022

COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarization

Traditional training paradigms for extractive and abstractive summarizat...
research
04/17/2018

Multi-Reward Reinforced Summarization with Saliency and Entailment

Abstractive text summarization is the task of compressing and rewriting ...
research
10/09/2021

Extending Multi-Text Sentence Fusion Resources via Pyramid Annotations

NLP models that compare or consolidate information across multiple docum...

Please sign up or login with your details

Forgot password? Click here to reset