Uncertainty-based Continual Learning with Adaptive Regularization

by   Hongjoon Ahn, et al.

We introduce a new regularization-based continual learning algorithm, dubbed as Uncertainty-regularized Continual Learning (UCL), that stores much smaller number of additional parameters for regularization terms than the recent state-of-the-art methods. Our approach builds upon the Bayesian learning framework, but makes a fresh interpretation of the variational approximation based regularization term and defines a notion of "uncertainty" for each hidden node in the network. The regularization parameter of each weight is then set to be large when the uncertainty of either of the node that the weight connects is small, since the weights connected to an important node should be less updated when a new task comes. Moreover, we add two additional regularization terms; one that promotes freezing the weights that are identified to be important (i.e., certain) for past tasks, and the other that gives flexibility to control the actively learning parameters for a new task by gracefully forgetting what was learned before. In results, we show our UCL outperforms most of recent state-of-the-art baselines on both supervised learning and reinforcement learning benchmarks.



There are no comments yet.


page 1

page 2

page 3

page 4


Adaptive Group Sparse Regularization for Continual Learning

We propose a novel regularization-based continual learning method, dubbe...

Uncertainty-guided Continual Learning with Bayesian Neural Networks

Continual learning aims to learn new tasks without forgetting previously...

CPR: Classifier-Projection Regularization for Continual Learning

We propose a general, yet simple patch that can be applied to existing r...

Nonparametric Bayesian Structure Adaptation for Continual Learning

Continual Learning is a learning paradigm where machine learning models ...

Regularization-based Continual Learning for Fault Prediction in Lithium-Ion Batteries

In recent years, the use of lithium-ion batteries has greatly expanded i...

Continual learning with direction-constrained optimization

This paper studies a new design of the optimization algorithm for traini...

Boosting a Model Zoo for Multi-Task and Continual Learning

Leveraging data from multiple tasks, either all at once, or incrementall...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.