DeepAI AI Chat
Log In Sign Up

Semi-Supervised Few-Shot Intent Classification and Slot Filling

09/17/2021
by   Samyadeep Basu, et al.
16

Intent classification (IC) and slot filling (SF) are two fundamental tasks in modern Natural Language Understanding (NLU) systems. Collecting and annotating large amounts of data to train deep learning models for such systems is not scalable. This problem can be addressed by learning from few examples using fast supervised meta-learning techniques such as prototypical networks. In this work, we systematically investigate how contrastive learning and unsupervised data augmentation methods can benefit these existing supervised meta-learning pipelines for jointly modelled IC/SF tasks. Through extensive experiments across standard IC/SF benchmarks (SNIPS and ATIS), we show that our proposed semi-supervised approaches outperform standard supervised meta-learning methods: contrastive losses in conjunction with prototypical networks consistently outperform the existing state-of-the-art for both IC and SF tasks, while data augmentation strategies primarily improve few-shot IC by a significant margin.

READ FULL TEXT

page 1

page 2

page 3

page 4

01/28/2021

ProtoDA: Efficient Transfer Learning for Few-Shot Intent Classification

Practical sequence classification tasks in natural language processing o...
02/02/2021

Neural Data Augmentation via Example Extrapolation

In many applications of machine learning, certain categories of examples...
10/26/2021

An Explicit-Joint and Supervised-Contrastive Learning Framework for Few-Shot Intent Classification and Slot Filling

Intent classification (IC) and slot filling (SF) are critical building b...
11/30/2020

Meta learning to classify intent and slot labels with noisy few shot examples

Recently deep learning has dominated many machine learning areas, includ...
10/14/2020

Data Augmentation for Meta-Learning

Conventional image classifiers are trained by randomly sampling mini-bat...
10/09/2019

A Closer Look At Feature Space Data Augmentation For Few-Shot Intent Classification

New conversation topics and functionalities are constantly being added t...
05/27/2021

ProtAugment: Unsupervised diverse short-texts paraphrasing for intent detection meta-learning

Recent research considers few-shot intent detection as a meta-learning p...