DeepAI AI Chat
Log In Sign Up

Assessing the Lexico-Semantic Relational Knowledge Captured by Word and Concept Embeddings

09/24/2019
by   Ronald Denaux, et al.
Expert System S.p.A.
0

Deep learning currently dominates the benchmarks for various NLP tasks and, at the basis of such systems, words are frequently represented as embeddings --vectors in a low dimensional space-- learned from large text corpora and various algorithms have been proposed to learn both word and concept embeddings. One of the claimed benefits of such embeddings is that they capture knowledge about semantic relations. Such embeddings are most often evaluated through tasks such as predicting human-rated similarity and analogy which only test a few, often ill-defined, relations. In this paper, we propose a method for (i) reliably generating word and concept pair datasets for a wide number of relations by using a knowledge graph and (ii) evaluating to what extent pre-trained embeddings capture those relations. We evaluate the approach against a proprietary and a public knowledge graph and analyze the results, showing which lexico-semantic relational knowledge is captured by current embedding learning approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

09/09/2019

Composing Knowledge Graph Embeddings via Word Embeddings

Learning knowledge graph embedding from an existing knowledge graph is v...
04/17/2020

Exploring the Combination of Contextual Word Embeddings and Knowledge Graph Embeddings

“Classical” word embeddings, such as Word2Vec, have been shown to captur...
06/22/2020

Exploiting Non-Taxonomic Relations for Measuring Semantic Similarity and Relatedness in WordNet

Various applications in the areas of computational linguistics and artif...
06/20/2018

The Corpus Replication Task

In the field of Natural Language Processing (NLP), we revisit the well-k...
09/07/2021

Learning grounded word meaning representations on similarity graphs

This paper introduces a novel approach to learn visually grounded meanin...
01/05/2021

Integration of Domain Knowledge using Medical Knowledge Graph Deep Learning for Cancer Phenotyping

A key component of deep learning (DL) for natural language processing (N...
03/09/2020

KGvec2go – Knowledge Graph Embeddings as a Service

In this paper, we present KGvec2go, a Web API for accessing and consumin...