Multi-turn Dialogue Reading Comprehension with Pivot Turns and Knowledge

by   Zhuosheng Zhang, et al.

Multi-turn dialogue reading comprehension aims to teach machines to read dialogue contexts and solve tasks such as response selection and answering questions. The major challenges involve noisy history contexts and especial prerequisites of commonsense knowledge that is unseen in the given material. Existing works mainly focus on context and response matching approaches. This work thus makes the first attempt to tackle the above two challenges by extracting substantially important turns as pivot utterances and utilizing external knowledge to enhance the representation of context. We propose a pivot-oriented deep selection model (PoDS) on top of the Transformer-based language models for dialogue comprehension. In detail, our model first picks out the pivot utterances from the conversation history according to the semantic matching with the candidate response or question, if any. Besides, knowledge items related to the dialogue context are extracted from a knowledge graph as external knowledge. Then, the pivot utterances and the external knowledge are combined with a well-designed mechanism for refining predictions. Experimental results on four dialogue comprehension benchmark tasks show that our proposed model achieves great improvements on baselines. A series of empirical comparisons are conducted to show how our selection strategies and the extra knowledge injection influence the results.


page 5

page 6

page 7

page 8

page 9

page 10

page 12

page 13


Multi-choice Dialogue-Based Reading Comprehension with Knowledge and Key Turns

Multi-choice machine reading comprehension (MRC) requires models to choo...

Advances in Multi-turn Dialogue Comprehension: A Survey

Training machines to understand natural language and interact with human...

Knowledge Augmented BERT Mutual Network in Multi-turn Spoken Dialogues

Modern spoken language understanding (SLU) systems rely on sophisticated...

FCM: A Fine-grained Comparison Model for Multi-turn Dialogue Reasoning

Despite the success of neural dialogue systems in achieving high perform...

Time to Transfer: Predicting and Evaluating Machine-Human Chatting Handoff

Is chatbot able to completely replace the human agent? The short answer ...

Multi-turn Response Selection using Dialogue Dependency Relations

Multi-turn response selection is a task designed for developing dialogue...

Unsupervised Injection of Knowledge into Dialogue Generation via Language Models

Neural conversation models have shown the power to produce more meaningf...