Composing Distributed Representations of Relational Patterns

07/23/2017
by   Sho Takase, et al.
0

Learning distributed representations for relation instances is a central technique in downstream NLP applications. In order to address semantic modeling of relational patterns, this paper constructs a new dataset that provides multiple similarity ratings for every pair of relational patterns on the existing dataset. In addition, we conduct a comparative study of different encoders including additive composition, RNN, LSTM, and GRU for composing distributed representations of relational patterns. We also present Gated Additive Composition, which is an enhancement of additive composition with the gating mechanism. Experiments show that the new dataset does not only enable detailed analyses of the different encoders, but also provides a gauge to predict successes of distributed representations of relational patterns in the relation classification task.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/04/2019

Composition of Sentence Embeddings:Lessons from Statistical Relational Learning

Various NLP problems -- such as the prediction of sentence similarity, e...
research
05/05/2022

Relational Representation Learning in Visually-Rich Documents

Relational understanding is critical for a number of visually-rich docum...
research
10/06/2021

Relation Prediction as an Auxiliary Training Objective for Improving Multi-Relational Graph Representations

Learning good representations on multi-relational graphs is essential to...
research
10/20/2020

Modeling Content and Context with Deep Relational Learning

Building models for realistic natural language tasks requires dealing wi...
research
11/14/2014

Learning Multi-Relational Semantics Using Neural-Embedding Models

In this paper we present a unified framework for modeling multi-relation...
research
11/26/2015

The Mechanism of Additive Composition

Additive composition (Foltz et al, 1998; Landauer and Dumais, 1997; Mitc...
research
10/24/2021

Distributed neural encoding of binding to thematic roles

A framework and method are proposed for the study of constituent composi...

Please sign up or login with your details

Forgot password? Click here to reset