DeepAI AI Chat
Log In Sign Up

Enhancing Word Embeddings with Knowledge Extracted from Lexical Resources

05/20/2020
by   Magdalena Biesialska, et al.
Universitat Politècnica de Catalunya
0

In this work, we present an effective method for semantic specialization of word vector representations. To this end, we use traditional word embeddings and apply specialization methods to better capture semantic relations between words. In our approach, we leverage external knowledge from rich lexical resources such as BabelNet. We also show that our proposed post-specialization method based on an adversarial neural network with the Wasserstein distance allows to gain improvements over state-of-the-art methods on two tasks: word similarity and dialog state tracking.

READ FULL TEXT

page 1

page 2

page 3

page 4

12/14/2019

Integrating Lexical Knowledge in Word Embeddings using Sprinkling and Retrofitting

Neural network based word embeddings, such as Word2Vec and GloVe, are pu...
10/03/2022

Lexical semantics enhanced neural word embeddings

Current breakthroughs in natural language processing have benefited dram...
07/11/2021

LexSubCon: Integrating Knowledge from Lexical Resources into Contextual Embeddings for Lexical Substitution

Lexical substitution is the task of generating meaningful substitutes fo...
07/30/2019

SenseFitting: Sense Level Semantic Specialization of Word Embeddings for Word Sense Disambiguation

We introduce a neural network-based system of Word Sense Disambiguation ...
01/22/2021

Enhanced word embeddings using multi-semantic representation through lexical chains

The relationship between words in a sentence often tells us more about t...
06/06/2019

Derivational Morphological Relations in Word Embeddings

Derivation is a type of a word-formation process which creates new words...
01/02/2023

Using meaning instead of words to track topics

The ability to monitor the evolution of topics over time is extremely va...