Short Text Classification via Knowledge powered Attention with Similarity Matrix based CNN

02/09/2020
by   Mingchen Li, et al.
0

Short text is becoming more and more popular on the web, such as Chat Message, SMS and Product Reviews. Accurately classifying short text is an important and challenging task. A number of studies have difficulties in addressing this problem because of the word ambiguity and data sparsity. To address this issue, we propose a knowledge powered attention with similarity matrix based convolutional neural network (KASM) model, which can compute comprehensive information by utilizing the knowledge and deep neural network. We use knowledge graph (KG) to enrich the semantic representation of short text, specially, the information of parent-entity is introduced in our model. Meanwhile, we consider the word interaction in the literal-level between short text and the representation of label, and utilize similarity matrix based convolutional neural network (CNN) to extract it. For the purpose of measuring the importance of knowledge, we introduce the attention mechanisms to choose the important information. Experimental results on five standard datasets show that our model significantly outperforms state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/21/2019

Deep Short Text Classification with Knowledge Powered Attention

Short text classification is one of important tasks in Natural Language ...
research
04/02/2019

Short Text Classification Improved by Feature Space Extension

With the explosive development of mobile Internet, short text has been a...
research
06/29/2020

Combine Convolution with Recurrent Networks for Text Classification

Convolutional neural network (CNN) and recurrent neural network (RNN) ar...
research
04/10/2018

Question Answering over Freebase via Attentive RNN with Similarity Matrix based CNN

With the rapid growth of knowledge bases (KBs), question answering over ...
research
06/29/2020

Multichannel CNN with Attention for Text Classification

Recent years, the approaches based on neural networks have shown remarka...
research
08/27/2018

Review Helpfulness Assessment based on Convolutional Neural Network

In this paper we describe the implementation of a convolutional neural n...
research
10/19/2021

Application of the Multi-label Residual Convolutional Neural Network text classifier using Content-Based Routing process

In this article, we will present an NLP application in text classifying ...

Please sign up or login with your details

Forgot password? Click here to reset