Incremental Prompting: Episodic Memory Prompt for Lifelong Event Detection

04/15/2022
by   Minqian Liu, et al.
0

Lifelong event detection aims to incrementally update a model with new event types and data while retaining the capability on previously learned old types. One critical challenge is that the model would catastrophically forget old types when continually trained on new data. In this paper, we introduce Episodic Memory Prompts (EMP) to explicitly preserve the learned task-specific knowledge. Our method adopts continuous prompt for each task and they are optimized to instruct the model prediction and learn event-specific representation. The EMPs learned in previous tasks are carried along with the model in subsequent tasks, and can serve as a memory module that keeps the old knowledge and transferring to new tasks. Experiment results demonstrate the effectiveness of our method. Furthermore, we also conduct a comprehensive analysis of the new and old event types in lifelong learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/03/2023

Balanced Destruction-Reconstruction Dynamics for Memory-replay Class Incremental Learning

Class incremental learning (CIL) aims to incrementally update a trained ...
research
10/23/2021

Multi-Domain Incremental Learning for Semantic Segmentation

Recent efforts in multi-domain learning for semantic segmentation attemp...
research
06/08/2018

SupportNet: solving catastrophic forgetting in class incremental learning with support data

A plain well-trained deep learning model often does not have the ability...
research
11/16/2017

Less-forgetful Learning for Domain Expansion in Deep Neural Networks

Expanding the domain that deep neural network has already learned withou...
research
09/29/2020

One Person, One Model, One World: Learning Continual User Representation without Forgetting

Learning generic user representations which can then be applied to other...
research
08/10/2021

Lifelong Intent Detection via Multi-Strategy Rebalancing

Conventional Intent Detection (ID) models are usually trained offline, w...
research
03/18/2023

EarCough: Enabling Continuous Subject Cough Event Detection on Hearables

Cough monitoring can enable new individual pulmonary health applications...

Please sign up or login with your details

Forgot password? Click here to reset