An Application of Reinforcement Learning to Dialogue Strategy Selection in a Spoken Dialogue System for Email

06/01/2011
by   M. A. Walker, et al.
0

This paper describes a novel method by which a spoken dialogue system can learn to choose an optimal dialogue strategy from its experience interacting with human users. The method is based on a combination of reinforcement learning and performance modeling of spoken dialogue systems. The reinforcement learning component applies Q-learning (Watkins, 1989), while the performance modeling component applies the PARADISE evaluation framework (Walker et al., 1997) to learn the performance function (reward) used in reinforcement learning. We illustrate the method with a spoken dialogue system named ELVIS (EmaiL Voice Interactive System), that supports access to email over the phone. We conduct a set of experiments for training an optimal dialogue strategy on a corpus of 219 dialogues in which human users interact with ELVIS over the phone. We then test that strategy on a corpus of 18 dialogues. We show that ELVIS can learn to optimize its strategy selection for agent initiative, for reading messages, and for summarizing email folders.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/03/2011

Optimizing Dialogue Management with Reinforcement Learning: Experiments with the NJFun System

Designing the dialogue policy of a spoken dialogue system involves many ...
research
07/19/2017

Reward-Balancing for Statistical Spoken Dialogue Systems using Multi-objective Reinforcement Learning

Reinforcement learning is widely used for dialogue policy optimization w...
research
06/09/2011

Automatically Training a Problematic Dialogue Predictor for a Spoken Dialogue System

Spoken dialogue systems promise efficient and natural access to a large ...
research
06/08/2016

Continuously Learning Neural Dialogue Management

We describe a two-step approach for dialogue management in task-oriented...
research
09/09/2016

Dialogue manager domain adaptation using Gaussian process reinforcement learning

Spoken dialogue systems allow humans to interact with machines using nat...
research
05/23/2023

CALLS: Japanese Empathetic Dialogue Speech Corpus of Complaint Handling and Attentive Listening in Customer Center

We present CALLS, a Japanese speech corpus that considers phone calls in...
research
08/03/2023

Investigating Reinforcement Learning for Communication Strategies in a Task-Initiative Setting

Many conversational domains require the system to present nuanced inform...

Please sign up or login with your details

Forgot password? Click here to reset