Keyword-Attentive Deep Semantic Matching

03/11/2020
by   Changyu Miao, et al.
0

Deep Semantic Matching is a crucial component in various natural language processing applications such as question and answering (QA), where an input query is compared to each candidate question in a QA corpus in terms of relevance. Measuring similarities between a query-question pair in an open domain scenario can be challenging due to diverse word tokens in the queryquestion pair. We propose a keyword-attentive approach to improve deep semantic matching. We first leverage domain tags from a large corpus to generate a domain-enhanced keyword dictionary. Built upon BERT, we stack a keyword-attentive transformer layer to highlight the importance of keywords in the query-question pair. During model training, we propose a new negative sampling approach based on keyword coverage between the input pair. We evaluate our approach on a Chinese QA corpus using various metrics, including precision of retrieval candidates and accuracy of semantic matching. Experiments show that our approach outperforms existing strong baselines. Our approach is general and can be applied to other text matching tasks with little adaptation.

READ FULL TEXT
research
02/27/2019

Multiresolution Graph Attention Networks for Relevance Matching

A large number of deep learning models have been proposed for the text m...
research
05/08/2019

FAQ Retrieval using Query-Question Similarity and BERT-Based Query-Answer Relevance

Frequently Asked Question (FAQ) retrieval is an important task where the...
research
08/27/2021

Dealing with Typos for BERT-based Passage Retrieval and Ranking

Passage retrieval and ranking is a key task in open-domain question answ...
research
02/07/2020

Translating Web Search Queries into Natural Language Questions

Users often query a search engine with a specific question in mind and o...
research
09/26/2017

Lexical Disambiguation in Natural Language Questions (NLQs)

Question processing is a fundamental step in a question answering (QA) a...
research
07/05/2018

Sanity Check: A Strong Alignment and Information Retrieval Baseline for Question Answering

While increasingly complex approaches to question answering (QA) have be...
research
08/23/2021

Sequence-to-Sequence Learning on Keywords for Efficient FAQ Retrieval

Frequently-Asked-Question (FAQ) retrieval provides an effective procedur...

Please sign up or login with your details

Forgot password? Click here to reset