Learning Distributed Representations of Texts and Entities from Knowledge Base

05/06/2017
by   Ikuya Yamada, et al.
0

We describe a neural network model that jointly learns distributed representations of texts and knowledge base (KB) entities. Given a text in the KB, we train our proposed model to predict entities that are relevant to the text. Our model is designed to be generic with the ability to address various NLP tasks with ease. We train the model using a large corpus of texts and their entity annotations extracted from Wikipedia. We evaluated the model on three important NLP tasks (i.e., sentence textual similarity, entity linking, and factoid question answering) involving both unsupervised and supervised settings. As a result, we achieved state-of-the-art results on all three of these tasks. Our code and trained models are publicly available for further academic research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/08/2018

Representation Learning of Entities and Documents from Knowledge Base Descriptions

In this paper, we describe TextEnt, a neural network model that learns d...
research
09/03/2019

Neural Attentive Bag-of-Entities Model for Text Classification

This study proposes a Neural Attentive Bag-of-Entities model, which is a...
research
06/25/2019

Model-based annotation of coreference

Humans do not make inferences over texts, but over models of what texts ...
research
04/10/2018

SWAT: A System for Detecting Salient Wikipedia Entities in Texts

We study the problem of entity salience by proposing the design and impl...
research
09/06/2019

Learning in Text Streams: Discovery and Disambiguation of Entity and Relation Instances

We consider a scenario where an artificial agent is reading a stream of ...
research
03/03/2020

HyperEmbed: Tradeoffs Between Resources and Performance in NLP Tasks with Hyperdimensional Computing enabled Embedding of n-gram Statistics

Recent advances in Deep Learning have led to a significant performance i...
research
09/01/2019

Pre-training of Deep Contextualized Embeddings of Words and Entities for Named Entity Disambiguation

Deep contextualized embeddings trained using unsupervised language model...

Please sign up or login with your details

Forgot password? Click here to reset