Neural Generative Rhetorical Structure Parsing

09/24/2019
by   Amandla Mabona, et al.
0

Rhetorical structure trees have been shown to be useful for several document-level tasks including summarization and document classification. Previous approaches to RST parsing have used discriminative models; however, these are less sample efficient than generative models, and RST parsing datasets are typically small. In this paper, we present the first generative model for RST parsing. Our model is a document-level RNN grammar (RNNG) with a bottom-up traversal order. We show that, for our parser's traversal order, previous beam search algorithms for RNNGs have a left-branching bias which is ill-suited for RST parsing. We develop a novel beam search algorithm that keeps track of both structure- and word-generating actions without exhibiting this branching bias and results in absolute improvements of 6.8 and 2.9 on unlabelled and labelled F1 over previous algorithms. Overall, our generative model outperforms a discriminative model with the same features by 2.6 F1 points and achieves performance comparable to the state-of-the-art, outperforming all published parsers from a recent replication study that do not use additional training data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/27/2017

Effective Inference for Generative Neural Parsing

Generative neural models have recently achieved state-of-the-art results...
research
07/10/2017

Improving Neural Parsing by Disentangling Model Combination and Reranking Effects

Recent work has proposed several generative neural models for constituen...
research
08/01/2017

A Generative Parser with a Discriminative Recognition Algorithm

Generative models defining joint distributions over parse trees and sent...
research
02/08/2021

In-Order Chart-Based Constituent Parsing

We propose a novel in-order chart-based model for constituent parsing. C...
research
05/02/2018

Constituency Parsing with a Self-Attentive Encoder

We demonstrate that replacing an LSTM encoder with a self-attentive arch...
research
08/02/2017

Combining Generative and Discriminative Approaches to Unsupervised Dependency Parsing via Dual Decomposition

Unsupervised dependency parsing aims to learn a dependency parser from u...
research
07/17/2017

In-Order Transition-based Constituent Parsing

Both bottom-up and top-down strategies have been used for neural transit...

Please sign up or login with your details

Forgot password? Click here to reset