An Attention-Based Word-Level Interaction Model: Relation Detection for Knowledge Base Question Answering

01/30/2018
by   Hongzhi Zhang, et al.
0

Relation detection plays a crucial role in Knowledge Base Question Answering (KBQA) because of the high variance of relation expression in the question. Traditional deep learning methods follow an encoding-comparing paradigm, where the question and the candidate relation are represented as vectors to compare their semantic similarity. Max- or average- pooling operation, which compresses the sequence of words into fixed-dimensional vectors, becomes the bottleneck of information. In this paper, we propose to learn attention-based word-level interactions between questions and relations to alleviate the bottleneck issue. Similar to the traditional models, the question and relation are firstly represented as sequences of vectors. Then, instead of merging the sequence into a single vector with pooling operation, soft alignments between words from the question and the relation are learned. The aligned words are subsequently compared with the convolutional neural network (CNN) and the comparison results are merged finally. Through performing the comparison on low-level representations, the attention-based word-level interaction model (ABWIM) relieves the information loss issue caused by merging the sequence into a fixed-dimensional vector before the comparison. The experimental results of relation detection on both SimpleQuestions and WebQuestions datasets show that ABWIM achieves state-of-the-art accuracy, demonstrating its effectiveness.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/20/2017

Improved Neural Relation Detection for Knowledge Base Question Answering

Relation detection is a core component for many NLP applications includi...
research
04/10/2018

Question Answering over Freebase via Attentive RNN with Similarity Matrix based CNN

With the rapid growth of knowledge bases (KBs), question answering over ...
research
03/01/2018

Knowledge Base Relation Detection via Multi-View Matching

Relation detection is a core component for Knowledge Base Question Answe...
research
04/04/2016

Character-Level Question Answering with Attention

We show that a character-level encoder-decoder framework can be successf...
research
06/03/2016

Question Answering over Knowledge Base with Neural Attention Combining Global Knowledge Information

With the rapid growth of knowledge bases (KBs) on the web, how to take f...
research
07/17/2019

Learning Representation Mapping for Relation Detection in Knowledge Base Question Answering

Relation detection is a core step in many natural language process appli...
research
07/16/2021

Exploiting Rich Syntax for Better Knowledge Base Question Answering

Recent studies on Knowledge Base Question Answering (KBQA) have shown gr...

Please sign up or login with your details

Forgot password? Click here to reset