Time Masking: Leveraging Temporal Information in Spoken Dialogue Systems

by   Rylan Conway, et al.

In a spoken dialogue system, dialogue state tracker (DST) components track the state of the conversation by updating a distribution of values associated with each of the slots being tracked for the current user turn, using the interactions until then. Much of the previous work has relied on modeling the natural order of the conversation, using distance based offsets as an approximation of time. In this work, we hypothesize that leveraging the wall-clock temporal difference between turns is crucial for finer-grained control of dialogue scenarios. We develop a novel approach that applies a time mask, based on the wall-clock time difference, to the associated slot embeddings and empirically demonstrate that our proposed approach outperforms existing approaches that leverage distance offsets, on both an internal benchmark dataset as well as DSTC2.


page 1

page 2

page 3

page 4


Improving Long Distance Slot Carryover in Spoken Dialogue Systems

Tracking the state of the conversation is a central component in task-or...

Scaling Multi-Domain Dialogue State Tracking via Query Reformulation

We present a novel approach to dialogue state tracking and referring exp...

Towards Universal Dialogue State Tracking

Dialogue state tracking is the core part of a spoken dialogue system. It...

Automatically Training a Problematic Dialogue Predictor for a Spoken Dialogue System

Spoken dialogue systems promise efficient and natural access to a large ...

Adapting Text-based Dialogue State Tracker for Spoken Dialogues

Although there have been remarkable advances in dialogue systems through...

Neural Dialogue State Tracking with Temporally Expressive Networks

Dialogue state tracking (DST) is an important part of a spoken dialogue ...

Current Challenges in Spoken Dialogue Systems and Why They Are Critical for Those Living with Dementia

Dialogue technologies such as Amazon's Alexa have the potential to trans...

Please sign up or login with your details

Forgot password? Click here to reset