An Explicit-Joint and Supervised-Contrastive Learning Framework for Few-Shot Intent Classification and Slot Filling

10/26/2021
by   Han Liu, et al.
0

Intent classification (IC) and slot filling (SF) are critical building blocks in task-oriented dialogue systems. These two tasks are closely-related and can flourish each other. Since only a few utterances can be utilized for identifying fast-emerging new intents and slots, data scarcity issue often occurs when implementing IC and SF. However, few IC/SF models perform well when the number of training samples per class is quite small. In this paper, we propose a novel explicit-joint and supervised-contrastive learning framework for few-shot intent classification and slot filling. Its highlights are as follows. (i) The model extracts intent and slot representations via bidirectional interactions, and extends prototypical network to achieve explicit-joint learning, which guarantees that IC and SF tasks can mutually reinforce each other. (ii) The model integrates with supervised contrastive learning, which ensures that samples from same class are pulled together and samples from different classes are pushed apart. In addition, the model follows a not common but practical way to construct the episode, which gets rid of the traditional setting with fixed way and shot, and allows for unbalanced datasets. Extensive experiments on three public datasets show that our model can achieve promising performance.

READ FULL TEXT
research
02/09/2021

Joint Intent Detection and Slot Filling with Wheel-Graph Attention Networks

Intent detection and slot filling are two fundamental tasks for building...
research
08/28/2023

Joint Multiple Intent Detection and Slot Filling with Supervised Contrastive Learning and Self-Distillation

Multiple intent detection and slot filling are two fundamental and cruci...
research
05/16/2022

A Fast Attention Network for Joint Intent Detection and Slot Filling on Edge Devices

Intent detection and slot filling are two main tasks in natural language...
research
09/17/2021

Semi-Supervised Few-Shot Intent Classification and Slot Filling

Intent classification (IC) and slot filling (SF) are two fundamental tas...
research
02/27/2023

Revisit Out-Of-Vocabulary Problem for Slot Filling: A Unified Contrastive Frameword with Multi-level Data Augmentations

In real dialogue scenarios, the existing slot filling model, which tends...
research
03/16/2021

Automatic Intent-Slot Induction for Dialogue Systems

Automatically and accurately identifying user intents and filling the as...
research
03/19/2019

Simple, Fast, Accurate Intent Classification and Slot Labeling

In real-time dialogue systems running at scale, there is a tradeoff betw...

Please sign up or login with your details

Forgot password? Click here to reset