Composed Variational Natural Language Generation for Few-shot Intents

09/21/2020
by   Congying Xia, et al.
0

In this paper, we focus on generating training examples for few-shot intents in the realistic imbalanced scenario. To build connections between existing many-shot intents and few-shot intents, we consider an intent as a combination of a domain and an action, and propose a composed variational natural language generator (CLANG), a transformer-based conditional variational autoencoder. CLANG utilizes two latent variables to represent the utterances corresponding to two different independent parts (domain and action) in the intent, and the latent variables are composed together to generate natural examples. Additionally, to improve the generator learning, we adopt the contrastive regularization loss that contrasts the in-class with the out-of-class utterance generation given the intent. To evaluate the quality of the generated utterances, experiments are conducted on the generalized few-shot intent detection task. Empirical results show that our proposed model achieves state-of-the-art performances on two real-world intent detection datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

04/04/2020

CG-BERT: Conditional Text Generation with BERT for Generalized Few-shot Intent Detection

In this paper, we formulate a more realistic and difficult problem setup...
05/03/2021

Pseudo Siamese Network for Few-shot Intent Generation

Few-shot intent detection is a challenging task due to the scare annotat...
09/13/2021

Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning

In this work, we focus on a more challenging few-shot intent detection s...
04/22/2021

Fuzzy Classification of Multi-intent Utterances

Current intent classification approaches assign binary intent class memb...
05/12/2021

OutFlip: Generating Out-of-Domain Samples for Unknown Intent Detection with Natural Language Attack

Out-of-domain (OOD) input detection is vital in a task-oriented dialogue...
05/31/2021

Factorising Meaning and Form for Intent-Preserving Paraphrasing

We propose a method for generating paraphrases of English questions that...
01/11/2021

Revisiting Mahalanobis Distance for Transformer-Based Out-of-Domain Detection

Real-life applications, heavily relying on machine learning, such as dia...