Controlling Decoding for More Abstractive Summaries with Copy-Based Networks

03/19/2018
by   Noah Weber, et al.
0

Attention-based neural abstractive summarization systems equipped with copy mechanisms have shown promising results. Despite this success, it has been noticed that such a system generates a summary by mostly, if not entirely, copying over phrases, sentences, and sometimes multiple consecutive sentences from an input paragraph, effectively performing extractive summarization. In this paper, we verify this behavior using the latest neural abstractive summarization system - a pointer-generator network. We propose a simple baseline method that allows us to control the amount of copying without retraining. Experiments indicate that the method provides a strong baseline for abstractive systems looking to obtain high ROUGE scores while minimizing overlap with the source article, substantially reducing the n-gram overlap with the original article while keeping within 2 points of the original model's ROUGE score.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/14/2018

Structure-Infused Copy Mechanisms for Abstractive Summarization

Seq2seq learning has produced promising results on summarization. Howeve...
research
11/23/2019

Controlling the Amount of Verbatim Copying in Abstractive Summarization

An abstract must not change the meaning of the original text. A single m...
research
04/20/2022

A Survey on Neural Abstractive Summarization Methods and Factual Consistency of Summarization

Automatic summarization is the process of shortening a set of textual da...
research
04/18/2019

Point-less: More Abstractive Summarization with Pointer-Generator Networks

The Pointer-Generator architecture has shown to be a big improvement for...
research
05/04/2021

Semantic Extractor-Paraphraser based Abstractive Summarization

The anthology of spoken languages today is inundated with textual inform...
research
06/03/2021

To Point or Not to Point: Understanding How Abstractive Summarizers Paraphrase Text

Abstractive neural summarization models have seen great improvements in ...
research
04/18/2021

Attention-based Clinical Note Summarization

The trend of deploying digital systems in numerous industries has induce...

Please sign up or login with your details

Forgot password? Click here to reset