Linguistically-Enriched and Context-Aware Zero-shot Slot Filling

01/16/2021
by   A. B. Siddique, et al.
0

Slot filling is identifying contiguous spans of words in an utterance that correspond to certain parameters (i.e., slots) of a user request/query. Slot filling is one of the most important challenges in modern task-oriented dialog systems. Supervised learning approaches have proven effective at tackling this challenge, but they need a significant amount of labeled training data in a given domain. However, new domains (i.e., unseen in training) may emerge after deployment. Thus, it is imperative that these models seamlessly adapt and fill slots from both seen and unseen domains – unseen domains contain unseen slot types with no training data, and even seen slots in unseen domains are typically presented in different contexts. This setting is commonly referred to as zero-shot slot filling. Little work has focused on this setting, with limited experimental evaluation. Existing models that mainly rely on context-independent embedding-based similarity measures fail to detect slot values in unseen domains or do so only partially. We propose a new zero-shot slot filling neural model, LEONA, which works in three steps. Step one acquires domain-oblivious, context-aware representations of the utterance word by exploiting (a) linguistic features; (b) named entity recognition cues; (c) contextual embeddings from pre-trained language models. Step two fine-tunes these rich representations and produces slot-independent tags for each word. Step three exploits generalizable context-aware utterance-slot similarity features at the word level, uses slot-independent tags, and contextualizes them to produce slot-specific predictions for each word. Our thorough evaluation on four diverse public datasets demonstrates that our approach consistently outperforms the SOTA models by 17.52 for unseen domains on SNIPS, ATIS, MultiWOZ, and SGD datasets, respectively.

READ FULL TEXT
research
06/17/2019

Robust Zero-Shot Cross-Domain Slot Filling with Example Values

Task-oriented dialog systems increasingly rely on deep learning-based sl...
research
11/24/2020

Zero-Shot Visual Slot Filling as Question Answering

This paper presents a new approach to visual zero-shot slot filling. The...
research
03/24/2023

Toward Open-domain Slot Filling via Self-supervised Co-training

Slot filling is one of the critical tasks in modern conversational syste...
research
11/05/2019

Improving Slot Filling by Utilizing Contextual Information

Slot Filling is the task of extracting the semantic concept from a given...
research
09/07/2023

Introducing "Forecast Utterance" for Conversational Data Science

Envision an intelligent agent capable of assisting users in conducting f...
research
07/06/2023

Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Prompting

Zero-shot cross-domain slot filling aims to transfer knowledge from the ...
research
07/04/2023

Knowledge-Aware Audio-Grounded Generative Slot Filling for Limited Annotated Data

Manually annotating fine-grained slot-value labels for task-oriented dia...

Please sign up or login with your details

Forgot password? Click here to reset