Deep Biaffine Attention for Neural Dependency Parsing

11/06/2016
by   Timothy Dozat, et al.
0

This paper builds off recent work from Kiperwasser & Goldberg (2016) using neural attention in a simple graph-based dependency parser. We use a larger but more thoroughly regularized parser than other recent BiLSTM-based approaches, with biaffine classifiers to predict arcs and labels. Our parser gets state of the art or near state of the art performance on standard treebanks for six different languages, achieving 95.7 English PTB dataset. This makes it the highest-performing graph-based parser on this benchmark---outperforming Kiperwasser Goldberg (2016) by 1.8 2.2 (Kuncoro et al., 2016), which achieves 95.8 which hyperparameter choices had a significant effect on parsing accuracy, allowing us to achieve large gains over other graph-based approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/24/2017

Encoder-Decoder Shift-Reduce Syntactic Parsing

Starting from NMT, encoder-decoder neu- ral networks have been used for ...
research
10/18/2018

Reduction of Parameter Redundancy in Biaffine Classifiers with Symmetric and Circulant Weight Matrices

Currently, the biaffine classifier has been attracting attention as a me...
research
07/11/2018

UniParse: A universal graph-based parsing toolkit

This paper describes the design and use of the graph-based parsing frame...
research
07/09/2021

Levi Graph AMR Parser using Heterogeneous Attention

Coupled with biaffine decoders, transformers have been effectively adapt...
research
04/17/2021

Question Decomposition with Dependency Graphs

QDMR is a meaning representation for complex questions, which decomposes...
research
06/01/2020

Distilling Neural Networks for Greener and Faster Dependency Parsing

The carbon footprint of natural language processing research has been in...
research
05/01/2017

Dependency Parsing with Dilated Iterated Graph CNNs

Dependency parses are an effective way to inject linguistic knowledge in...

Please sign up or login with your details

Forgot password? Click here to reset