Continual Learning with Optimal Transport based Mixture Model

11/30/2022
by   Quyen Tran, et al.
0

Online Class Incremental learning (CIL) is a challenging setting in Continual Learning (CL), wherein data of new tasks arrive in incoming streams and online learning models need to handle incoming data streams without revisiting previous ones. Existing works used a single centroid adapted with incoming data streams to characterize a class. This approach possibly exposes limitations when the incoming data stream of a class is naturally multimodal. To address this issue, in this work, we first propose an online mixture model learning approach based on nice properties of the mature optimal transport theory (OT-MM). Specifically, the centroids and covariance matrices of the mixture model are adapted incrementally according to incoming data streams. The advantages are two-fold: (i) we can characterize more accurately complex data streams and (ii) by using centroids for each class produced by OT-MM, we can estimate the similarity of an unseen example to each class more reasonably when doing inference. Moreover, to combat the catastrophic forgetting in the CIL scenario, we further propose Dynamic Preservation. Particularly, after performing the dynamic preservation technique across data streams, the latent representations of the classes in the old and new tasks become more condensed themselves and more separate from each other. Together with a contraction feature extractor, this technique facilitates the model in mitigating the catastrophic forgetting. The experimental results on real-world datasets show that our proposed method can significantly outperform the current state-of-the-art baselines.

READ FULL TEXT
research
04/18/2021

Dynamically Addressing Unseen Rumor via Continual Learning

Rumors are often associated with newly emerging events, thus, an ability...
research
06/10/2020

Self-Supervised Learning Aided Class-Incremental Lifelong Learning

Lifelong or continual learning remains to be a challenge for artificial ...
research
07/11/2022

Learning an evolved mixture model for task-free continual learning

Recently, continual learning (CL) has gained significant interest becaus...
research
03/20/2020

Online Continual Learning on Sequences

Online continual learning (OCL) refers to the ability of a system to lea...
research
07/20/2022

Continual Variational Autoencoder Learning via Online Cooperative Memorization

Due to their inference, data representation and reconstruction propertie...
research
08/24/2023

A Continual Learning Approach for Cross-Domain White Blood Cell Classification

Accurate classification of white blood cells in peripheral blood is esse...
research
07/22/2020

Storage Fit Learning with Feature Evolvable Streams

Feature evolvable learning has been widely studied in recent years where...

Please sign up or login with your details

Forgot password? Click here to reset