Title-Guided Encoding for Keyphrase Generation

08/26/2018
by   Wang Chen, et al.
0

Keyphrase generation (KG) aims to generate a set of keyphrases given a document, which is a fundamental task in natural language processing (NLP). Most previous methods solve this problem in an extractive manner, while recently, several attempts are made under the generative setting using deep neural networks. However, the state-of-the-art generative methods simply treat the document title and the document main body equally, ignoring the leading role of the title to the overall document. To solve this problem, we introduce a new model called Title-Guided Network (TG-Net) for automatic keyphrase generation task based on the encoder-decoder architecture with two new features: (i) the title is additionally employed as a query-like input, and (ii) a title-guided encoder gathers the relevant information from the title to each word in the document. Experiments on a range of KG datasets demonstrate that our model outperforms the state-of-the-art models with a large margin, especially for documents with either very low or very high title length ratios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/04/2020

Select, Extract and Generate: Neural Keyphrase Generation with Syntactic Guidance

In recent years, deep neural sequence-to-sequence framework has demonstr...
research
04/25/2022

ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference

State-of-the-art neural models typically encode document-query pairs usi...
research
09/14/2021

KFCNet: Knowledge Filtering and Contrastive Learning Network for Generative Commonsense Reasoning

Pre-trained language models have led to substantial gains over a broad r...
research
06/10/2019

Neural Keyphrase Generation via Reinforcement Learning with Adaptive Rewards

Generating keyphrases that summarize the main points of a document is a ...
research
04/27/2023

ChatGPT vs State-of-the-Art Models: A Benchmarking Study in Keyphrase Generation Task

Transformer-based language models, including ChatGPT, have demonstrated ...
research
10/07/2020

Knowledge-enriched, Type-constrained and Grammar-guided Question Generation over Knowledge Bases

Question generation over knowledge bases (KBQG) aims at generating natur...
research
04/18/2020

Exclusive Hierarchical Decoding for Deep Keyphrase Generation

Keyphrase generation (KG) aims to summarize the main ideas of a document...

Please sign up or login with your details

Forgot password? Click here to reset