Log In Sign Up

Multi-task Sentence Encoding Model for Semantic Retrieval in Question Answering Systems

by   Qiang Huang, et al.

Question Answering (QA) systems are used to provide proper responses to users' questions automatically. Sentence matching is an essential task in the QA systems and is usually reformulated as a Paraphrase Identification (PI) problem. Given a question, the aim of the task is to find the most similar question from a QA knowledge base. In this paper, we propose a Multi-task Sentence Encoding Model (MSEM) for the PI problem, wherein a connected graph is employed to depict the relation between sentences, and a multi-task learning model is applied to address both the sentence matching and sentence intent classification problem. In addition, we implement a general semantic retrieval framework that combines our proposed model and the Approximate Nearest Neighbor (ANN) technology, which enables us to find the most similar question from all available candidates very quickly during online serving. The experiments show the superiority of our proposed method as compared with the existing sentence matching models.


page 1

page 2

page 3

page 4


TCNN: Triple Convolutional Neural Network Models for Retrieval-based Question Answering System in E-commerce

Automatic question-answering (QA) systems have boomed during last few ye...

FAQ-based Question Answering via Knowledge Anchors

Question answering (QA) aims to understand user questions and find appro...

Multi-Task Learning with Multi-View Attention for Answer Selection and Knowledge Base Question Answering

Answer selection and knowledge base question answering (KBQA) are two im...

Question-Aware Sentence Gating Networks for Question and Answering

Machine comprehension question answering, which finds an answer to the q...

Visual Question Answering as a Multi-Task Problem

Visual Question Answering(VQA) is a highly complex problem set, relying ...

Tradeoffs in Sentence Selection Techniques for Open-Domain Question Answering

Current methods in open-domain question answering (QA) usually employ a ...

Keyword-Attentive Deep Semantic Matching

Deep Semantic Matching is a crucial component in various natural languag...