Multidirectional Associative Optimization of Function-Specific Word Representations

05/11/2020
by   Daniela Gerz, et al.
0

We present a neural framework for learning associations between interrelated groups of words such as the ones found in Subject-Verb-Object (SVO) structures. Our model induces a joint function-specific word vector space, where vectors of e.g. plausible SVO compositions lie close together. The model retains information about word group membership even in the joint space, and can thereby effectively be applied to a number of tasks reasoning over the SVO structure. We show the robustness and versatility of the proposed framework by reporting state-of-the-art results on the tasks of estimating selectional preference and event similarity. The results indicate that the combinations of representations learned with our task-independent model outperform task-specific architectures from prior work, while reducing the number of parameters by up to 95

READ FULL TEXT

page 2

page 5

page 6

page 7

page 8

page 9

page 10

page 11

research
07/28/2015

Reasoning about Linguistic Regularities in Word Embeddings using Matrix Manifolds

Recent work has explored methods for learning continuous vector space wo...
research
06/28/2016

Hierarchical Neural Language Models for Joint Representation of Streaming Documents and their Content

We consider the problem of learning distributed representations for docu...
research
04/24/2015

Efficient Non-parametric Estimation of Multiple Embeddings per Word in Vector Space

There is rising interest in vector-space word embeddings and their use i...
research
03/02/2016

Counter-fitting Word Vectors to Linguistic Constraints

In this work, we present a novel counter-fitting method which injects an...
research
11/02/2016

Fuzzy paraphrases in learning word representations with a lexicon

A synonym of a polysemous word is usually only the paraphrase of one sen...
research
03/15/2018

Word2Bits - Quantized Word Vectors

Word vectors require significant amounts of memory and storage, posing i...
research
08/31/2019

Joint Detection and Location of English Puns

A pun is a form of wordplay for an intended humorous or rhetorical effec...

Please sign up or login with your details

Forgot password? Click here to reset