DeepAI AI Chat
Log In Sign Up

Neural Attentive Bag-of-Entities Model for Text Classification

by   Ikuya Yamada, et al.
Studio Ousia
Nara Institute of Science and Technology

This study proposes a Neural Attentive Bag-of-Entities model, which is a neural network model that performs text classification using entities in a knowledge base. Entities provide unambiguous and relevant semantic signals that are beneficial for capturing semantics in texts. We combine simple high-recall entity detection based on a dictionary, to detect entities in a document, with a novel neural attention mechanism that enables the model to focus on a small number of unambiguous and relevant entities. We tested the effectiveness of our model using two standard text classification datasets (i.e., the 20 Newsgroups and R8 datasets) and a popular factoid question answering dataset based on a trivia quiz game. As a result, our model achieved state-of-the-art results on all datasets. The source code of the proposed model will be available online at


page 1

page 2

page 3

page 4


Learning Distributed Representations of Texts and Entities from Knowledge Base

We describe a neural network model that jointly learns distributed repre...

Interactive Semantic Featuring for Text Classification

In text classification, dictionaries can be used to define human-compreh...

Text Classification Models for Form Entity Linking

Forms are a widespread type of template-based document used in a great v...

Representation Learning of Entities and Documents from Knowledge Base Descriptions

In this paper, we describe TextEnt, a neural network model that learns d...

Evolutionary Data Measures: Understanding the Difficulty of Text Classification Tasks

Classification tasks are usually analysed and improved through new model...