Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems

03/21/2017
by   Xiujun Li, et al.
0

Language understanding is a key component in a spoken dialogue system. In this paper, we investigate how the language understanding module influences the dialogue system performance by conducting a series of systematic experiments on a task-oriented neural dialogue system in a reinforcement learning based setting. The empirical study shows that among different types of language understanding errors, slot-level errors can have more impact on the overall performance of a dialogue system compared to intent-level errors. In addition, our experiments demonstrate that the reinforcement learning based dialogue system is able to learn when and what to confirm in order to achieve better performance and greater robustness.

READ FULL TEXT
research
05/08/2017

Sequential Dialogue Context Modeling for Spoken Language Understanding

Spoken Language Understanding (SLU) is a key component of goal oriented ...
research
04/14/2023

Dialogue Games for Benchmarking Language Understanding: Motivation, Taxonomy, Strategy

How does one measure "ability to understand language"? If it is a person...
research
03/03/2017

End-to-End Task-Completion Neural Dialogue Systems

One of the major drawbacks of modularized task-completion dialogue syste...
research
10/01/2018

Joint On-line Learning of a Zero-shot Spoken Semantic Parser and a Reinforcement Learning Dialogue Manager

Despite many recent advances for the design of dialogue systems, a true ...
research
03/24/2011

On Understanding and Machine Understanding

In the present paper, we try to propose a self-similar network theory fo...
research
06/05/2019

Memory Consolidation for Contextual Spoken Language Understanding with Dialogue Logistic Inference

Dialogue contexts are proven helpful in the spoken language understandin...
research
10/05/2021

NaRLE: Natural Language Models using Reinforcement Learning with Emotion Feedback

Current research in dialogue systems is focused on conversational assist...

Please sign up or login with your details

Forgot password? Click here to reset