Multi-turn Dialogue Reading Comprehension with Pivot Turns and Knowledge

02/10/2021
by   Zhuosheng Zhang, et al.
4

Multi-turn dialogue reading comprehension aims to teach machines to read dialogue contexts and solve tasks such as response selection and answering questions. The major challenges involve noisy history contexts and especial prerequisites of commonsense knowledge that is unseen in the given material. Existing works mainly focus on context and response matching approaches. This work thus makes the first attempt to tackle the above two challenges by extracting substantially important turns as pivot utterances and utilizing external knowledge to enhance the representation of context. We propose a pivot-oriented deep selection model (PoDS) on top of the Transformer-based language models for dialogue comprehension. In detail, our model first picks out the pivot utterances from the conversation history according to the semantic matching with the candidate response or question, if any. Besides, knowledge items related to the dialogue context are extracted from a knowledge graph as external knowledge. Then, the pivot utterances and the external knowledge are combined with a well-designed mechanism for refining predictions. Experimental results on four dialogue comprehension benchmark tasks show that our proposed model achieves great improvements on baselines. A series of empirical comparisons are conducted to show how our selection strategies and the extra knowledge injection influence the results.

READ FULL TEXT

page 5

page 6

page 7

page 8

page 9

page 10

page 12

page 13

04/29/2020

Multi-choice Dialogue-Based Reading Comprehension with Knowledge and Key Turns

Multi-choice machine reading comprehension (MRC) requires models to choo...
03/04/2021

Advances in Multi-turn Dialogue Comprehension: A Survey

Training machines to understand natural language and interact with human...
02/23/2022

Knowledge Augmented BERT Mutual Network in Multi-turn Spoken Dialogues

Modern spoken language understanding (SLU) systems rely on sophisticated...
09/22/2021

FCM: A Fine-grained Comparison Model for Multi-turn Dialogue Reasoning

Despite the success of neural dialogue systems in achieving high perform...
12/14/2020

Time to Transfer: Predicting and Evaluating Machine-Human Chatting Handoff

Is chatbot able to completely replace the human agent? The short answer ...
10/04/2020

Multi-turn Response Selection using Dialogue Dependency Relations

Multi-turn response selection is a task designed for developing dialogue...
04/30/2020

Unsupervised Injection of Knowledge into Dialogue Generation via Language Models

Neural conversation models have shown the power to produce more meaningf...