Prompt Learning With Knowledge Memorizing Prototypes For Generalized Few-Shot Intent Detection

09/10/2023
by   Chaiyut Luoyiching, et al.
0

Generalized Few-Shot Intent Detection (GFSID) is challenging and realistic because it needs to categorize both seen and novel intents simultaneously. Previous GFSID methods rely on the episodic learning paradigm, which makes it hard to extend to a generalized setup as they do not explicitly learn the classification of seen categories and the knowledge of seen intents. To address the dilemma, we propose to convert the GFSID task into the class incremental learning paradigm. Specifically, we propose a two-stage learning framework, which sequentially learns the knowledge of different intents in various periods via prompt learning. And then we exploit prototypes for categorizing both seen and novel intents. Furthermore, to achieve the transfer knowledge of intents in different stages, for different scenarios we design two knowledge preservation methods which close to realistic applications. Extensive experiments and detailed analyses on two widely used datasets show that our framework based on the class incremental learning paradigm achieves promising performance.

READ FULL TEXT
research
06/22/2022

Template-based Approach to Zero-shot Intent Recognition

The recent advances in transfer learning techniques and pre-training of ...
research
12/03/2020

Learning Disentangled Intent Representations for Zero-shot Intent Detection

Zero-shot intent detection (ZSID) aims to deal with the continuously eme...
research
02/04/2021

Generalized Zero-shot Intent Detection via Commonsense Knowledge

Identifying user intents from natural language utterances is a crucial s...
research
09/17/2019

Alleviating Feature Confusion for Generative Zero-shot Learning

Lately, generative adversarial networks (GANs) have been successfully ap...
research
08/09/2023

Prototypical Kernel Learning and Open-set Foreground Perception for Generalized Few-shot Semantic Segmentation

Generalized Few-shot Semantic Segmentation (GFSS) extends Few-shot Seman...
research
09/17/2019

ProtoGAN: Towards Few Shot Learning for Action Recognition

Few-shot learning (FSL) for action recognition is a challenging task of ...
research
05/03/2021

Pseudo Siamese Network for Few-shot Intent Generation

Few-shot intent detection is a challenging task due to the scare annotat...

Please sign up or login with your details

Forgot password? Click here to reset