Self-Attentive Model for Headline Generation

01/23/2019
by   Daniil Gavrilov, et al.
0

Headline generation is a special type of text summarization task. While the amount of available training data for this task is almost unlimited, it still remains challenging, as learning to generate headlines for news articles implies that the model has strong reasoning about natural language. To overcome this issue, we applied recent Universal Transformer architecture paired with byte-pair encoding technique and achieved new state-of-the-art results on the New York Times Annotated corpus with ROUGE-L F1-score 24.84 and ROUGE-2 F1-score 13.48. We also present the new RIA corpus and reach ROUGE-L F1-score 36.81 and ROUGE-2 F1-score 22.15 on it.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/22/2022

Taygete at SemEval-2022 Task 4: RoBERTa based models for detecting Patronising and Condescending Language

This work describes the development of different models to detect patron...
research
12/28/2019

Tha3aroon at NSURL-2019 Task 8: Semantic Question Similarity in Arabic

In this paper, we describe our team's effort on the semantic text questi...
research
01/10/2022

Polish Natural Language Inference and Factivity – an Expert-based Dataset and Benchmarks

Despite recent breakthroughs in Machine Learning for Natural Language Pr...
research
07/09/2023

Marine Debris Detection in Satellite Surveillance using Attention Mechanisms

Marine debris is an important issue for environmental protection, but cu...
research
05/12/2020

Classification of Infant Crying in Real-World Home Environments Using Deep Learning

In the domain of social signal processing, automated audio recognition i...
research
02/14/2023

Generation of Highlights from Research Papers Using Pointer-Generator Networks and SciBERT Embeddings

Nowadays many research articles are prefaced with research highlights to...
research
08/15/2023

ChartDETR: A Multi-shape Detection Network for Visual Chart Recognition

Visual chart recognition systems are gaining increasing attention due to...

Please sign up or login with your details

Forgot password? Click here to reset