aNMM: Ranking Short Answer Texts with Attention-Based Neural Matching Model

by   Liu Yang, et al.

As an alternative to question answering methods based on feature engineering, deep learning approaches such as convolutional neural networks (CNNs) and Long Short-Term Memory Models (LSTMs) have recently been proposed for semantic matching of questions and answers. To achieve good results, however, these models have been combined with additional features such as word overlap or BM25 scores. Without this combination, these models perform significantly worse than methods based on linguistic feature engineering. In this paper, we propose an attention based neural matching model for ranking short answer text. We adopt value-shared weighting scheme instead of position-shared weighting scheme for combining different matching signals and incorporate question term importance learning using question attention network. Using the popular benchmark TREC QA data, we show that the relatively simple aNMM model can significantly outperform other neural network models that have been used for the question answering task, and is competitive with models that are combined with additional features. When aNMM is combined with additional features, it outperforms all baselines.



There are no comments yet.


page 7


Hyperbolic Representation Learning for Fast and Efficient Neural Question Answering

The dominant neural architectures in question answer retrieval are based...

LSTM-based Deep Learning Models for Non-factoid Answer Selection

In this paper, we apply a general deep learning (DL) framework for the a...

Cross-lingual Short-text Matching with Deep Learning

The problem of short text matching is formulated as follows: given a pai...

Answer Sequence Learning with Neural Networks for Answer Selection in Community Question Answering

In this paper, the answer selection problem in community question answer...

Attention-Based Convolutional Neural Network for Machine Comprehension

Understanding open-domain text is one of the primary challenges in natur...

Learning to Focus when Ranking Answers

One of the main challenges in ranking is embedding the query and documen...

A strong baseline for question relevancy ranking

The best systems at the SemEval-16 and SemEval-17 community question ans...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

1 Introduction