The Corpus Replication Task

06/20/2018
by   Tobias Eichinger, et al.
0

In the field of Natural Language Processing (NLP), we revisit the well-known word embedding algorithm word2vec. Word embeddings identify words by vectors such that the words' distributional similarity is captured. Unexpectedly, besides semantic similarity even relational similarity has been shown to be captured in word embeddings generated by word2vec, whence two questions arise. Firstly, which kind of relations are representable in continuous space and secondly, how are relations built. In order to tackle these questions we propose a bottom-up point of view. We call generating input text for which word2vec outputs target relations solving the Corpus Replication Task. Deeming generalizations of this approach to any set of relations possible, we expect solving of the Corpus Replication Task to provide partial answers to the questions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/02/2016

New word analogy corpus for exploring embeddings of Czech words

The word embedding methods have been proven to be very useful in many ta...
research
06/10/2016

PSDVec: a Toolbox for Incremental and Scalable Word Embedding

PSDVec is a Python/Perl toolbox that learns word embeddings, i.e. the ma...
research
12/28/2017

Corpus specificity in LSA and Word2vec: the role of out-of-domain documents

Latent Semantic Analysis (LSA) and Word2vec are some of the most widely ...
research
04/11/2022

Word Embeddings Are Capable of Capturing Rhythmic Similarity of Words

Word embedding systems such as Word2Vec and GloVe are well-known in deep...
research
09/24/2019

Assessing the Lexico-Semantic Relational Knowledge Captured by Word and Concept Embeddings

Deep learning currently dominates the benchmarks for various NLP tasks a...
research
11/18/2020

Topology of Word Embeddings: Singularities Reflect Polysemy

The manifold hypothesis suggests that word vectors live on a submanifold...
research
09/19/2017

An Optimality Proof for the PairDiff operator for Representing Relations between Words

Representing the semantic relations that exist between two given words (...

Please sign up or login with your details

Forgot password? Click here to reset