Non-distributional Word Vector Representations

06/17/2015
by   Manaal Faruqui, et al.
0

Data-driven representation learning for words is a technique of central importance in NLP. While indisputably useful as a source of features in downstream tasks, such vectors tend to consist of uninterpretable components whose relationship to the categories of traditional lexical semantic theories is tenuous at best. We present a method for constructing interpretable word vectors from hand-crafted linguistic resources like WordNet, FrameNet etc. These vectors are binary (i.e, contain only 0 and 1) and are 99.9 analyze their performance on state-of-the-art evaluation methods for distributional models of word vectors and find they are competitive to standard distributional approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/08/2018

Post-Specialisation: Retrofitting Vectors of Words Unseen in Lexical Resources

Word vector specialisation (also known as retrofitting) is a portable, l...
research
05/25/2016

Integrating Distributional Lexical Contrast into Word Embeddings for Antonym-Synonym Distinction

We propose a novel vector representation that integrates lexical contras...
research
11/05/2019

Sparse Lifting of Dense Vectors: Unifying Word and Sentence Representations

As the first step in automated natural language processing, representing...
research
05/06/2020

What are the Goals of Distributional Semantics?

Distributional semantic models have become a mainstay in NLP, providing ...
research
02/06/2018

A Neurobiologically Motivated Analysis of Distributional Semantic Models

The pervasive use of distributional semantic models or word embeddings i...
research
05/20/2021

A comprehensive comparative evaluation and analysis of Distributional Semantic Models

Distributional semantics has deeply changed in the last decades. First, ...
research
07/20/2017

High-risk learning: acquiring new word vectors from tiny data

Distributional semantics models are known to struggle with small data. I...

Please sign up or login with your details

Forgot password? Click here to reset