Evaluating the Utility of Document Embedding Vector Difference for Relation Learning

07/18/2019
by   Jingyuan Zhang, et al.
0

Recent work has demonstrated that vector offsets obtained by subtracting pretrained word embedding vectors can be used to predict lexical relations with surprising accuracy. Inspired by this finding, in this paper, we extend the idea to the document level, in generating document-level embeddings, calculating the distance between them, and using a linear classifier to classify the relation between the documents. In the context of duplicate detection and dialogue act tagging tasks, we show that document-level difference vectors have utility in assessing document-level similarity, but perform less well in multi-relational classification.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/23/2019

Vector of Locally-Aggregated Word Embeddings (VLAWE): A novel document-level embedding

In this paper, we propose a novel representation for text documents base...
research
02/23/2019

Vector of Locally-Aggregated Word Embeddings (VLAWE): A Novel Document-level Representation

In this paper, we propose a novel representation for text documents base...
research
09/05/2015

Take and Took, Gaggle and Goose, Book and Read: Evaluating the Utility of Vector Differences for Lexical Relation Learning

Recent work on word embeddings has shown that simple vector subtraction ...
research
06/30/2020

Segmentation Approach for Coreference Resolution Task

In coreference resolution, it is important to consider all members of a ...
research
10/09/2018

Unsupervised Object Matching for Relational Data

We propose an unsupervised object matching method for relational data, w...
research
05/26/2020

Embedding Vector Differences Can Be Aligned With Uncertain Intensional Logic Differences

The DeepWalk algorithm is used to assign embedding vectors to nodes in t...
research
02/26/2019

Improving a tf-idf weighted document vector embedding

We examine a number of methods to compute a dense vector embedding for a...

Please sign up or login with your details

Forgot password? Click here to reset