Dialogue State Tracking with a Language Model using Schema-Driven Prompting

09/15/2021
by   Chia-Hsuan Lee, et al.
0

Task-oriented conversational systems often use dialogue state tracking to represent the user's intentions, which involves filling in values of pre-defined slots. Many approaches have been proposed, often using task-specific architectures with special-purpose classifiers. Recently, good results have been obtained using more general architectures based on pretrained language models. Here, we introduce a new variation of the language modeling approach that uses schema-driven prompting to provide task-aware history encoding that is used for both categorical and non-categorical slots. We further improve performance by augmenting the prompting with schema descriptions, a naturally occurring source of in-domain knowledge. Our purely generative system achieves state-of-the-art performance on MultiWOZ 2.2 and achieves competitive performance on two other benchmarks: MultiWOZ 2.1 and M2M. The data and code will be available at https://github.com/chiahsuan156/DST-as-Prompting.

READ FULL TEXT
research
04/08/2022

Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue

Building universal dialogue systems that can seamlessly operate across m...
research
10/05/2022

Schema Encoding for Transferable Dialogue State Tracking

Dialogue state tracking (DST) is an essential sub-task for task-oriented...
research
09/12/2019

Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Dataset

Virtual assistants such as Google Assistant, Alexa and Siri provide a co...
research
03/17/2023

More Robust Schema-Guided Dialogue State Tracking via Tree-Based Paraphrase Ranking

The schema-guided paradigm overcomes scalability issues inherent in buil...
research
07/08/2022

Hidden Schema Networks

Most modern language models infer representations that, albeit powerful,...
research
06/15/2023

Span-Selective Linear Attention Transformers for Effective and Robust Schema-Guided Dialogue State Tracking

In schema-guided dialogue state tracking models estimate the current sta...
research
09/17/2021

Towards Handling Unconstrained User Preferences in Dialogue

A user input to a schema-driven dialogue information navigation system, ...

Please sign up or login with your details

Forgot password? Click here to reset