Learning to parse from a semantic objective: It works. Is it syntax?

09/04/2017
by   Adina Williams, et al.
0

Recent work on reinforcement learning and other gradient estimators for latent tree learning has made it possible to train neural networks that learn to both parse a sentence and use the resulting parse to interpret the sentence, all without exposure to ground-truth parse trees at training time. Surprisingly, these models often perform better at sentence understanding tasks than models that use parse trees from conventional parsers. This paper aims to investigate what these latent tree learning models learn. We replicate two such models in a shared codebase and find that (i) they do outperform baselines on sentence classification, but that (ii) their parsing strategies are not especially consistent across random restarts, (iii) the parses they produce tend to be shallower than PTB parses, and (iv) these do not resemble those of PTB or of any other recognizable semantic or syntactic grammar formalism.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/17/2018

ListOps: A Diagnostic Dataset for Latent Tree Learning

Latent tree learning models learn to parse a sentence without syntactic ...
research
06/03/2018

Latent Tree Learning with Differentiable Parsers: Shift-Reduce Parsing and Chart Parsing

Latent tree learning models represent sentences by composing their words...
research
01/19/2022

CPTAM: Constituency Parse Tree Aggregation Method

Diverse Natural Language Processing tasks employ constituency parsing to...
research
11/26/2020

Encoding Syntactic Constituency Paths for Frame-Semantic Parsing with Graph Convolutional Networks

We study the problem of integrating syntactic information from constitue...
research
06/26/2019

A Generative Model for Punctuation in Dependency Trees

Treebanks traditionally treat punctuation marks as ordinary words, but l...
research
08/29/2018

On Tree-Based Neural Sentence Modeling

Neural networks with tree-based sentence encoders have shown better resu...
research
10/10/2020

Latent Tree Learning with Ordered Neurons: What Parses Does It Produce?

Recent latent tree learning models can learn constituency parsing withou...

Please sign up or login with your details

Forgot password? Click here to reset