Finding Interpretable Concept Spaces in Node Embeddings using Knowledge Bases

10/11/2019
by   Maximilian Idahl, et al.
0

In this paper we propose and study the novel problem of explaining node embeddings by finding embedded human interpretable subspaces in already trained unsupervised node representation embeddings. We use an external knowledge base that is organized as a taxonomy of human-understandable concepts over entities as a guide to identify subspaces in node embeddings learned from an entity graph derived from Wikipedia. We propose a method that given a concept finds a linear transformation to a subspace where the structure of the concept is retained. Our initial experiments show that we obtain low error in finding fine-grained concepts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/01/2018

Beyond Word Embeddings: Learning Entity and Concept Representations from Large Scale Knowledge Bases

Text representation using neural word embeddings has proven efficacy in ...
research
04/30/2020

Interpretable Entity Representations through Large-Scale Typing

In standard methodology for natural language processing, entities in tex...
research
01/28/2022

Adversarial Concept Erasure in Kernel Space

The representation space of neural models for textual data emerges in an...
research
04/21/2019

Understanding Stability of Medical Concept Embeddings: Analysis and Prediction

In biomedical area, medical concepts linked to external knowledge bases ...
research
12/03/2022

Intermediate Entity-based Sparse Interpretable Representation Learning

Interpretable entity representations (IERs) are sparse embeddings that a...
research
12/22/2018

TaxoGen: Unsupervised Topic Taxonomy Construction by Adaptive Term Embedding and Clustering

Taxonomy construction is not only a fundamental task for semantic analys...
research
10/18/2022

Linear Guardedness and its Implications

Previous work on concept identification in neural representations has fo...

Please sign up or login with your details

Forgot password? Click here to reset