Select, Extract and Generate: Neural Keyphrase Generation with Syntactic Guidance

by   Wasi Uddin Ahmad, et al.
Verizon Media

In recent years, deep neural sequence-to-sequence framework has demonstrated promising results in keyphrase generation. However, processing long documents using such deep neural networks requires high computational resources. To reduce the computational cost, the documents are typically truncated before given as inputs. As a result, the models may miss essential points conveyed in a document. Moreover, most of the existing methods are either extractive (identify important phrases from the document) or generative (generate phrases word by word), and hence they do not benefit from the advantages of both modeling techniques. To address these challenges, we propose SEG-Net, a neural keyphrase generation model that is composed of two major components, (1) a selector that selects the salient sentences in a document, and (2) an extractor-generator that jointly extracts and generates keyphrases from the selected sentences. SEG-Net uses a self-attentive architecture, known as, Transformer as the building block with a couple of uniqueness. First, SEG-Net incorporates a novel layer-wise coverage attention to summarize most of the points discussed in the target document. Second, it uses an informed copy attention mechanism to encourage focusing on different segments of the document during keyphrase extraction and generation. Besides, SEG-Net jointly learns keyphrase generation and their part-of-speech tag prediction, where the later provides syntactic supervision to the former. The experimental results on seven keyphrase generation benchmarks from scientific and web documents demonstrate that SEG-Net outperforms the state-of-the-art neural generative methods by a large margin in both domains.


page 1

page 2

page 3

page 4


Title-Guided Encoding for Keyphrase Generation

Keyphrase generation (KG) aims to generate a set of keyphrases given a d...

Keyphrase Generation with Correlation Constraints

In this paper, we study automatic keyphrase generation. Although convent...

Keyphrase Extraction with Span-based Feature Representations

Keyphrases are capable of providing semantic metadata characterizing doc...

Capturing Greater Context for Question Generation

Automatic question generation can benefit many applications ranging from...

Unsupervised Deep Keyphrase Generation

Keyphrase generation aims to summarize long documents with a collection ...

UniKeyphrase: A Unified Extraction and Generation Framework for Keyphrase Prediction

Keyphrase Prediction (KP) task aims at predicting several keyphrases tha...

VS-Net: Multiscale Spatiotemporal Features for Lightweight Video Salient Document Detection

Video Salient Document Detection (VSDD) is an essential task of practica...

Please sign up or login with your details

Forgot password? Click here to reset