Machine Reading Comprehension for Answer Re-Ranking in Customer Support Chatbots

02/12/2019
by   Momchil Hardalov, et al.
0

Recent advances in deep neural networks, language modeling and language generation have introduced new ideas to the field of conversational agents. As a result, deep neural models such as sequence-to-sequence, Memory Networks, and the Transformer have become key ingredients of state-of-the-art dialog systems. While those models are able to generate meaningful responses even in unseen situation, they need a lot of training data to build a reliable model. Thus, most real-world systems stuck to traditional approaches based on information retrieval and even hand-crafted rules, due to their robustness and effectiveness, especially for narrow-focused conversations. Here, we present a method that adapts a deep neural architecture from the domain of machine reading comprehension to re-rank the suggested answers from different models using the question as context. We train our model using negative sampling based on question-answer pairs from the Twitter Customer Support Dataset.The experimental results show that our re-ranking framework can improve the performance in terms of word overlap and semantics both for individual models as well as for model combinations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/02/2018

Towards Automated Customer Support

Recent years have seen growing interest in conversational agents, such a...
research
12/10/2017

Contextualized Word Representations for Reading Comprehension

Reading a document and extracting an answer to a question about its cont...
research
10/31/2016

End-to-End Answer Chunk Extraction and Ranking for Reading Comprehension

This paper proposes dynamic chunk reader (DCR), an end-to-end neural rea...
research
03/15/2018

Deep Choice Model Using Pointer Networks for Airline Itinerary Prediction

Travel providers such as airlines and on-line travel agents are becoming...
research
02/24/2022

Using calibrator to improve robustness in Machine Reading Comprehension

Machine Reading Comprehension(MRC) has achieved a remarkable result sinc...
research
12/07/2020

Semantics Altering Modifications for Evaluating Comprehension in Machine Reading

Advances in NLP have yielded impressive results for the task of machine ...
research
09/16/2022

Interactions in Information Spread

Since the development of writing 5000 years ago, human-generated data ge...

Please sign up or login with your details

Forgot password? Click here to reset