Top-down Tree Long Short-Term Memory Networks

10/31/2015
by   Xingxing Zhang, et al.
0

Long Short-Term Memory (LSTM) networks, a type of recurrent neural network with a more complex computational unit, have been successfully applied to a variety of sequence modeling tasks. In this paper we develop Tree Long Short-Term Memory (TreeLSTM), a neural network model based on LSTM, which is designed to predict a tree rather than a linear sequence. TreeLSTM defines the probability of a sentence by estimating the generation probability of its dependency tree. At each time step, a node is generated based on the representation of the generated sub-tree. We further enhance the modeling power of TreeLSTM by explicitly representing the correlations between left and right dependents. Application of our model to the MSR sentence completion challenge achieves results beyond the current state of the art. We also report results on dependency parsing reranking achieving competitive performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/28/2015

Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks

Because of their superior ability to preserve sequence information over ...
research
09/16/2015

Guiding Long-Short Term Memory for Image Caption Generation

In this work we focus on the problem of image caption generation. We pro...
research
08/15/2015

Classifying Relations via Long Short Term Memory Networks along Shortest Dependency Path

Relation classification is an important research arena in the field of n...
research
10/27/2017

Advanced LSTM: A Study about Better Time Dependency Modeling in Emotion Recognition

Long short-term memory (LSTM) is normally used in recurrent neural netwo...
research
09/10/2021

Modeling Human Sentence Processing with Left-Corner Recurrent Neural Network Grammars

In computational linguistics, it has been shown that hierarchical struct...
research
04/06/2019

Parallelizable Stack Long Short-Term Memory

Stack Long Short-Term Memory (StackLSTM) is useful for various applicati...
research
09/24/2018

Text Summarization as Tree Transduction by Top-Down TreeLSTM

Extractive compression is a challenging natural language processing prob...

Please sign up or login with your details

Forgot password? Click here to reset