Continual Learning with Knowledge Transfer for Sentiment Classification

12/18/2021
by   Zixuan Ke, et al.
11

This paper studies continual learning (CL) for sentiment classification (SC). In this setting, the CL system learns a sequence of SC tasks incrementally in a neural network, where each task builds a classifier to classify the sentiment of reviews of a particular product category or domain. Two natural questions are: Can the system transfer the knowledge learned in the past from the previous tasks to the new task to help it learn a better model for the new task? And, can old models for previous tasks be improved in the process as well? This paper proposes a novel technique called KAN to achieve these objectives. KAN can markedly improve the SC accuracy of both the new task and the old tasks via forward and backward knowledge transfer. The effectiveness of KAN is demonstrated through extensive experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/06/2021

Adapting BERT for Continual Learning of a Sequence of Aspect Sentiment Classification Tasks

This paper studies continual learning (CL) of a sequence of aspect senti...
research
12/05/2021

CLASSIC: Continual and Contrastive Learning of Aspect Sentiment Classification Tasks

This paper studies continual learning (CL) of a sequence of aspect senti...
research
01/09/2018

Lifelong Learning for Sentiment Classification

This paper proposes a novel lifelong learning (LL) approach to sentiment...
research
01/05/2022

Hyperparameter-free Continuous Learning for Domain Classification in Natural Language Understanding

Domain classification is the fundamental task in natural language unders...
research
06/08/2019

Forward and Backward Knowledge Transfer for Sentiment Classification

This paper studies the problem of learning a sequence of sentiment class...
research
06/26/2023

Parameter-Level Soft-Masking for Continual Learning

Existing research on task incremental learning in continual learning has...
research
07/11/2023

Towards Robust and Efficient Continual Language Learning

As the application space of language models continues to evolve, a natur...

Please sign up or login with your details

Forgot password? Click here to reset