Topic-Selective Graph Network for Topic-Focused Summarization

02/25/2023
by   Shi Zesheng, et al.
0

Due to the success of the pre-trained language model (PLM), existing PLM-based summarization models show their powerful generative capability. However, these models are trained on general-purpose summarization datasets, leading to generated summaries failing to satisfy the needs of different readers. To generate summaries with topics, many efforts have been made on topic-focused summarization. However, these works generate a summary only guided by a prompt comprising topic words. Despite their success, these methods still ignore the disturbance of sentences with non-relevant topics and only conduct cross-interaction between tokens by attention module. To address this issue, we propose a topic-arc recognition objective and topic-selective graph network. First, the topic-arc recognition objective is used to model training, which endows the capability to discriminate topics for the model. Moreover, the topic-selective graph network can conduct topic-guided cross-interaction on sentences based on the results of topic-arc recognition. In the experiments, we conduct extensive evaluations on NEWTS and COVIDET datasets. Results show that our methods achieve state-of-the-art performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/20/2016

Topic Sensitive Neural Headline Generation

Neural models have recently been used in text summarization including he...
research
10/21/2021

Topic-Guided Abstractive Multi-Document Summarization

A critical point of multi-document summarization (MDS) is to learn the r...
research
01/16/2020

Intweetive Text Summarization

The amount of user generated contents from various social medias allows ...
research
08/21/2022

GRETEL: Graph Contrastive Topic Enhanced Language Model for Long Document Extractive Summarization

Recently, neural topic models (NTMs) have been incorporated into pre-tra...
research
06/09/2022

Topic-Aware Evaluation and Transformer Methods for Topic-Controllable Summarization

Topic-controllable summarization is an emerging research area with a wid...
research
11/29/2016

Less is More: Learning Prominent and Diverse Topics for Data Summarization

Statistical topic models efficiently facilitate the exploration of large...

Please sign up or login with your details

Forgot password? Click here to reset