Planning and Acting under Uncertainty: A New Model for Spoken Dialogue Systems

01/10/2013
by   Bo Zhang, et al.
0

Uncertainty plays a central role in spoken dialogue systems. Some stochastic models like Markov decision process (MDP) are used to model the dialogue manager. But the partially observable system state and user intention hinder the natural representation of the dialogue state. MDP-based system degrades fast when uncertainty about a user's intention increases. We propose a novel dialogue model based on the partially observable Markov decision process (POMDP). We use hidden system states and user intentions as the state set, parser results and low-level information as the observation set, domain actions and dialogue repair actions as the action set. Here the low-level information is extracted from different input modals, including speech, keyboard, mouse, etc., using Bayesian networks. Because of the limitation of the exact algorithms, we focus on heuristic approximation algorithms and their applicability in POMDP for dialogue management. We also propose two methods for grid point selection in grid-based approximation algorithms.

READ FULL TEXT

page 3

page 5

page 7

research
09/22/2020

Distributed Structured Actor-Critic Reinforcement Learning for Universal Dialogue Management

The task-oriented spoken dialogue system (SDS) aims to assist a human us...
research
02/16/2016

POMDP-lite for Robust Robot Planning under Uncertainty

The partially observable Markov decision process (POMDP) provides a prin...
research
09/17/2018

Hidden Markov Model Estimation-Based Q-learning for Partially Observable Markov Decision Process

The objective is to study an on-line Hidden Markov model (HMM) estimatio...
research
09/01/2022

On Almost-Sure Intention Deception Planning that Exploits Imperfect Observers

Intention deception involves computing a strategy which deceives the opp...
research
10/31/2019

Cascaded LSTMs based Deep Reinforcement Learning for Goal-driven Dialogue

This paper proposes a deep neural network model for joint modeling Natur...
research
09/09/2013

Technical Report: Distribution Temporal Logic: Combining Correctness with Quality of Estimation

We present a new temporal logic called Distribution Temporal Logic (DTL)...
research
04/18/2021

A Simulated Experiment to Explore Robotic Dialogue Strategies for People with Dementia

People with Alzheimer's disease and related dementias (ADRD) often show ...

Please sign up or login with your details

Forgot password? Click here to reset