Question Answering over Freebase via Attentive RNN with Similarity Matrix based CNN

04/10/2018
by   Yingqi Qu, et al.
0

With the rapid growth of knowledge bases (KBs), question answering over knowledge base, a.k.a. KBQA has drawn huge attention in recent years. Most of the existing KBQA methods follow so called encoder-compare framework. They map the question and the KB facts to a common embedding space, in which the similarity between the question vector and the fact vectors can be conveniently computed. This, however, inevitably loses original words interaction information. To preserve more original information, we propose an attentive recurrent neural network with similarity matrix based convolutional neural network (AR-SMCNN) model, which is able to capture comprehensive hierarchical information utilizing the advantages of both RNN and CNN. We use RNN to capture semantic-level correlation by its sequential modeling nature, and use an attention mechanism to keep track of the entities and relations simultaneously. Meanwhile, we use a similarity matrix based CNN with two-directions pooling to extract literal-level words interaction matching utilizing CNNs strength of modeling spatial correlation among data. Moreover, we have developed a new heuristic extension method for entity detection, which significantly decreases the effect of noise. Our method has outperformed the state-of-the-arts on SimpleQuestion benchmark in both accuracy and efficiency.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/30/2018

An Attention-Based Word-Level Interaction Model: Relation Detection for Knowledge Base Question Answering

Relation detection plays a crucial role in Knowledge Base Question Answe...
research
06/10/2016

Simple Question Answering by Attentive Convolutional Neural Network

This work focuses on answering single-relation factoid questions over Fr...
research
02/09/2020

Short Text Classification via Knowledge powered Attention with Similarity Matrix based CNN

Short text is becoming more and more popular on the web, such as Chat Me...
research
03/23/2016

Recurrent Neural Network Encoder with Attention for Community Question Answering

We apply a general recurrent neural network (RNN) encoder framework to c...
research
03/06/2019

Bidirectional Attentive Memory Networks for Question Answering over Knowledge Bases

When answering natural language questions over knowledge bases (KB), dif...
research
05/29/2018

Semantic Sentence Matching with Densely-connected Recurrent and Co-attentive Information

Sentence matching is widely used in various natural language tasks such ...
research
02/11/2016

Attentive Pooling Networks

In this work, we propose Attentive Pooling (AP), a two-way attention mec...

Please sign up or login with your details

Forgot password? Click here to reset