Modeling Compositionality with Multiplicative Recurrent Neural Networks

12/20/2014
by   Ozan Irsoy, et al.
0

We present the multiplicative recurrent neural network as a general model for compositional meaning in language, and evaluate it on the task of fine-grained sentiment analysis. We establish a connection to the previously investigated matrix-space models for compositionality, and show they are special cases of the multiplicative recurrent net. Our experiments show that these models perform comparably or better than Elman-type additive recurrent neural networks and outperform matrix-space models on a standard fine-grained sentiment analysis corpus. Furthermore, they yield comparable results to structural deep models on the recently published Stanford Sentiment Treebank without the need for generating parse trees.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/12/2017

Multitask Learning for Fine-Grained Twitter Sentiment Analysis

Traditional sentiment analysis approaches tackle problems like ternary (...
research
06/22/2017

Explaining Recurrent Neural Network Predictions in Sentiment Analysis

Recently, a technique called Layer-wise Relevance Propagation (LRP) was ...
research
07/31/2017

Bayesian Sparsification of Recurrent Neural Networks

Recurrent neural networks show state-of-the-art results in many text ana...
research
04/30/2018

Recurrent Entity Networks with Delayed Memory Update for Targeted Aspect-based Sentiment Analysis

While neural networks have been shown to achieve impressive results for ...
research
07/14/2016

Using Recurrent Neural Network for Learning Expressive Ontologies

Recently, Neural Networks have been proven extremely effective in many n...
research
09/08/2022

ReX: A Framework for Generating Local Explanations to Recurrent Neural Networks

We propose a general framework to adapt various local explanation techni...
research
04/11/2021

Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa

Aspect-based Sentiment Analysis (ABSA), aiming at predicting the polarit...

Please sign up or login with your details

Forgot password? Click here to reset