LenAtten: An Effective Length Controlling Unit For Text Summarization

06/01/2021
by   Zhongyi Yu, et al.
0

Fixed length summarization aims at generating summaries with a preset number of words or characters. Most recent researches incorporate length information with word embeddings as the input to the recurrent decoding unit, causing a compromise between length controllability and summary quality. In this work, we present an effective length controlling unit Length Attention (LenAtten) to break this trade-off. Experimental results show that LenAtten not only brings improvements in length controllability and ROGUE scores but also has great generalization ability. In the task of generating a summary with the target length, our model is 732 times better than the best-performing length controllable summarizer in length controllability on the CNN/Daily Mail dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/21/2020

Length-controllable Abstractive Summarization by Guiding with Summary Prototype

We propose a new length-controllable abstractive summarization model. Re...
research
12/14/2021

Reinforced Abstractive Summarization with Adaptive Length Controlling

Document summarization, as a fundamental task in natural language genera...
research
05/09/2023

Summarization with Precise Length Control

Many applications of text generation such as summarization benefit from ...
research
09/24/2022

A Focused Study on Sequence Length for Dialogue Summarization

Output length is critical to dialogue summarization systems. The dialogu...
research
03/28/2019

A Large-Scale Multi-Length Headline Corpus for Improving Length-Constrained Headline Generation Model Evaluation

Browsing news articles on multiple devices is now possible. The lengths ...
research
04/16/2019

Positional Encoding to Control Output Sequence Length

Neural encoder-decoder models have been successful in natural language g...
research
04/17/2018

Multi-Reward Reinforced Summarization with Saliency and Entailment

Abstractive text summarization is the task of compressing and rewriting ...

Please sign up or login with your details

Forgot password? Click here to reset